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FOREWORD 


The  System  Effectiveness  Data  System  (SEDS)  Study 
was  performed  by  TRW  Systems,  Redondo  Beach,  California- 
under  contract  number  F04  697-67-C-0002.  The  program 
continued  from  1  October  1967  to  15  March  1968  and  was 
monitored  by  Mr.  E.  A.  Denning  (SAMS  O/ SMSIR).  This 
document  was  submitted  for  final  approval  1  March.  1968. 

The  TRW  Systems  personnel  contributing  to  the  SEDS 
program  and  this  report  were  Drs.  N.  S.  D'Andrea  DuBois, 
Jr.;  B.  Ostrofsky;  Messrs.  T.  S.  Arnold;  J.  Cook;  J.  A.  Jones 
(SMSgt,  USAF,  Ret);  J.  McGivern;  W.  A.  Ulman  and  other 
support  personnel.  The  following  Air  Force  personnel  and 
activities  also  contributed  directly  to  the  SEDS  program: 
Mr.  E.  A.  Denning  (SAMSO/SMSIR);  Lt.  Col.  R.  R.  Stanton 
(AFSC/SCS-22);  Major  T.D.  Hill,  Edwards  AFB  Flight  Test 
Center  (FTTED);  and  pe  r  s  onne  l  of  the  Data  Automation 
Division  (FTTSD)  Edwards  AFB,  California. 

This  technical  report  has  been  reviewed  and  is 

approved. 


Deputy  Chief,  Tech 
Requirements  and  Std3  Ofc 
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ABSTRACT 


This  report  represents  the  continued  development  effort  of  SEDS  for 
the  time  period  1  November  1967  to  15  March  1968.  The  effort  was  con¬ 
ducted  at  Edwards  AFB  on  the  IBM  7  044/7  094  computer.  F-  1 11 A  Category  II 
operating  data  (AFSC  258/258-4  and  the  Mission  Debriefing  Form)  was 
stored  on  tapes  using  the  IBM  Formatted  File  System  (FFS-V8).  Problems 
were  defined  by  the  F-lll  System  Project  Office  (SPO)  and  the  Air  Force 
Logistics  Command  Sacramento  Material  Area  (AFLC/SMAMA)  for  which 
solutions  were  to  be  obtained.  These  problems  were  associated  with  the 
eleven  most  Critical  Line  Replaceable  Units  (LRU)  in  the  F-lll  which  were 
defined  for  SEDS  by  SMAMA  and  the.  resident  provisioning  team  (RPT)'  at 
Fort  Worth.  The  problems  were: 

(1)  Distribution  of  total  maintenance  for  each  LRU. 

(2)  Relationships  between  LRU  replacement  and 
failure  (maintenance  descrepancy); 

(3)  Replacement  estimate  for  each  mission  type. 

(4)  Estimate  for  replacements  per  1  00  flying  hours 
for  each  LRU. 

Solutions  were  provided  within  the  allotted  time  period  for  these  problems 
while  simultaneously  proceeding  with  the  programming  activities,  to  make 
(FFS-V8)  operational. 

Solutions  were  provided  for  problem  (1)  for  both  flight  line  and  shop 
activities  where  the  event  was  defined  as  all  activities  associated  with  the 
total  system.  Problems  (2)  and  (3)  were  solved  as  planned.  Problem  (4) 
was  solved  as  planned  with  the  additional  result  of  the  probability  distri¬ 
bution  associated  with  each  LRU  replacement  requirement.  That  is,  the 
probability  of  not  exceeding  a  given  replacement  value  was  provided. 

This  study  demonstrated  that  storage  and  retrieval  of  a  large  volume 
of  operating  and  maintenance  data  on  a  timely  basis  appears  feasible.  Also 
that  Category  II  operating  data  can  be  used  to  provide  relatively  accurate 
estimates  of  system  operating  parameters  and/or  requirements.  This 
study  further  demonstrates  the  usefulness  of  the  258/mission  debriefing 
data  for  providing  estimates  of  reliability/maintainability  parameters  and 
other  information. 
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i.  0  INTRODUCTION 


In  order  to  study  the  problem  of  automatically  storing  and  retrieving 
the  type  of  information  needed’ to  estimate  effectiveness  parameters  of 
weapon  systems  the  Air  Force  Systems  Command  (AFSC)  at  Norton  Air 
Force  Base,  California,  initiated  the  Reliability  Information  and- Monitor¬ 
ing,  System  (RIMS).  For  details  see  the  Ballistic  Systems  Division,  Report 
No-.  BSD-TR-64-169.  This  initial  effort  has  been  extended  under  Reliabil¬ 
ity  Information/ Monitoring  System  Capability  Demonstration  Project, 
Report  No.  BSD-TOR-669  (S6855-12)- i,.  System  Experience  Correlation 
and  Analysis  Program  (SECAP),  Space  and  Missile  Systems  Organization 
(SAMSO)  Report  No.  67^12  and  the  System  Effectiveness  Data, Systems 
(SEDS)  which  is  covered  in  this  report.,  SEDS  is  an  exploratory  develop¬ 
ment  effort  to'  enhance  Air  Force  data  storage,  retrieval,  and  analysis 
capability  of  weapon  systems'  mission  performance  data.  In  this  current 
study  the  following  areas  are  investigated:  (1)  the  distribution  of  mainte- 
nance/events,  (2)  the  relationship  between  replacements  and  failure  indi¬ 
cations,  (3)  the  expected  number  of , replaces  \ents  per  mission  type,  and 
(4)  the  estimate  ^replacements  per  100  flying  hours  for  each  LRU.  The 
above  areas  are  shidied  in  connection  with  F-lil  Category  II  Testing 
Program  at  Edwards  AFB,  California.  However,  the  techniques  *developed' 
here  can  be  applied  to  other  weapon  systems. 

1.  1  HISTORY  OF  THE  PROJECT 

The- System  Effectiveness  Data  System  (SEDS),. study  is  an  extension 
of  the  work  accomplished  under  the  System  Experience  Correlation  and 
Analysis  Program  (SECAP)  (SAMSO  Report  Mo.  67-12). 

SECAP  was  an  exploratory  development  effort  to  enhance  AFSC  data 
storage,  retrieval,  and  analysis  capability,  particularly  in  the  areas  of 
reliability,  maintainability,  and  effectiveness  evaluation.  This  effort  was 
accomplished  at  Norton  Air  Force  Base,  California,  using  AFSC/ 258  and 
the  Mission  Debriefing  Form  ,(0-294). 

The  SECAP  effort  was  preceded  by  the  Reliability  Information  Moni¬ 
toring  System  (RIMS)  study,  BSD  Reports  Nr.  TR-64-169  and  No.  TOR-669 
(S6855- 12)- 1,  This  study  considered  the  feasibility  of  using  a  computer 
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implemented  storage  and  retrieval  system  for  storing  and  retrieving 
reliability  and  maintainability  histories  on  weapon  systemsi  As  a  result 
of  this  study  the  IBM,  Formatted  File  System  (FSS)  developed  for  the 
Air  Force  Strategic  Air  Command  (SAC),  under  contracts  AF  19(628)- 525 
and  F  30(602}-  67- C- 0252,  was  implemented  on  the  IBM  7094  Computer 
at  Nor'  on  Air  Force  Base,  California,  using  reliability  and  maintain¬ 
ability  data  for  Minuteman  and  early  Category  II  Tests  Data  for  the 
F- 1 1 1  as  a  data  base.  In  order  to  analyze  the  information  retrieved  from 
the  above  data  base,  a  statistical  analysis  capability  was  developed  under 
SECAE; 

In  order  to  develop  an  on  site  capability  the  project  was  moved  to 
Edwards  Air  Force  Base,  California,  and  given  tasks  to  perform  for  the 
SPO  while  simultaneously  developing  a  subsequent  form  of  the  automated 
file  for  storage  and  retrieval  o£ Category  II  operations  data  at  EAFB. 

The  tasks  were  primarily  to  determine  if  products  could  be  developed  to 
support  AFLG  provisioning  activities  at  McClellan  AFB,  Scaramento, 
California  (SMAMA).  Since  the  Formatted  File  System  was  being  updated 
for  current  manipulation  by  EAFB  personnel,  products  from  the  study 
were  largely  experimental  in  nature  and  provided  a  real  measure  of  poten¬ 
tial  for  the  F-lli  data  and  SEDS  by  illustrating  timely  and  successful 
achievement  of  the  desired  products  for  AFLC  provisioning. 

1.  2  REQUIREMENTS  FOR  SEDS 

Engineers  concerned  with  reliability,  maintainability  and  provision¬ 
ing  planning  for  weapon  systems  usually  have  to  make  assumptions  con¬ 
cerning  the  performance  of  the  system  under  consideration.  Obviously, 
provisioning  requirements  based  on  the  assumed  performance  of  a  weapon 
system  will  be  inadequate.  Thus,  in  order  to  provide  accurate  estimates 
of  the  provisioning  requirements  associated  with  a  maintenance  policy  for 
any  weapon  system,  it  is  necessary  that  actual  performance  data  be 
available.  In  this  regard,  the  purpose  of  SEDS  was  to  develop  a  program 
for  providing  estimates  of  parameters  and/or  criteria  for  measurement  of 
operational  effectiveness  from  actual  data.  This  wa.s  approached  by 
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(1)  Implementing  an  operational/ maintenance  data  base 
using  an  IBM  7094  computer  facility  at  Edwards  AFB. 

(2)  Developing  analytical  techniques  and  models  which  could 
be  used  with  the  data  base  for  producing  parameters 
and/or  distributions  of  parameters  for  evaluating 

F- 1 1 1A  Category  II  operational  performance. 

(3)  Providing  a  method  for  extending  this  measurement 
capability  to  the  using  Commands  to  improve  manage¬ 
ment  decision-making. 

1. 3  DUALITY  OF  CURRENT  EFFORT 

To  accomplish  SEDS  the  AFSC  258  and  mission  debriefing  data  were 
stored  in  the  Edwards  AFB  computer  and  used  during  subsequent  activities 
to  produce  products.  Because  of  current  USAF  budgeting  problems  it  was 
decided  to  accelerate  the  time  frame  for  the  total  activity  and  simulta¬ 
neously  attempt  to  alleviate  some  current  problems  for  the  F-lll  SPO. 

At  their  direction;  the  provisioning  team  at  SMAMA  and  at  Fort  Worth 
were  included  in  the  coordination  effort  and  agreement  reached  on  several 
urgent  problems  for  which  the  SEDS  activities  appeared  to  be  helpful. 

Consequently,  the  SEDS  program  was  placed  in  the  position  of  pro¬ 
viding  solutions  to  existing  problems  prior  to  having  FFS  operational  at 
EAFB.  It  is  to  the  credit  of  EAFB  and  contractor  personnel  that  useful 
solutions  were  provided  within  the  allowed  time  period  while  development 
of  the  basic  data  system  continued.  It  is  of  interest  to  note  that  the  pro¬ 
ducts  for  F-lli  SPO  (Section  5.  1  through  5.  5)  could  have  been  produced  in 
approximately  one -third  of  the  time  had  the  258/debriefing  data  been 
completely  debugged  when  the  current  study  began. 
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2.  0  RESOURCE  AVAILABILITY 


The  basic  resources  required  by  SEDS  are  as  follows: 

(1)  A  computer  system  v/ith  the  IBM  Formatted  File 
System,  FORTRAN  IV  and  COBOL  installed. 

(2)  'Technical  personnel  as  described  in  the  SECAP 
Report  (SAMSO  67-12). 

(3)  A  data  base  containing  maintenance  and  mission 
debriefing  data  oh  the  weapon  system  of  interest. 

A  complete  description  of  the  resources  available  to  SEDSis  dis¬ 
cussed  in  the  following  sections. 

2.  1  COMPUTER  FACILITIES 

The  computing  facilities  at  Edwards  AFB  (FTTSD)  were  made  avail¬ 
able  to  the  SEDS  working  group.  The  computer  hardware  consisted  of  a 
Direct  Coupled  System  (DCS),  i.  e. ,  an  IBM  7044/7094  Model  I  with  a  card 
read/ punch,  six  magnetic  tape  units,  a  double  module  1301  disk  and  two 
printers.  The  basis  operating,  system  for  the  IBM  7044  at  FTTSD  is  code 
named  "IRETMUPOS"  (INTEGRATED  REAL-TIME  MULTIPROCESSOR 
OPERATING  SYSTEM).  In  general  IRETMUPOS  controls  the  job  through¬ 
put  for  DCS.  On  the  other  hand;  the  basis  operating  system  for  the 
IBM  7094  is  IBSYS  (Version  13)  which  contains  SORT,  IB  JOB",  UPDATE 
and  FFS  as  subsystems. 

2.2  PERSONNEL  UTILIZATION 

Under  SECAP  requirements  for  technical  personnel  necessary  for 
the  analysis  and  development  of  automated  solutions  of  systems  effective¬ 
ness  data  reduction  problems  were  developed.  The  composition  of  the 
SEDS  team  was  based  on  these  requirements  (SAMSO  Report  No.  67-12). 

Four  to  eight  individuals  possessing  the  above  qualifications  were 
assigned  to  SEDS  and  utilized  as  required  to  solve  the  problems  posed  in 
Section  5.  0  through  5.  5.  Two  of  these  individuals  were  management  and 
analytically  oriented  and  the  remaining  personnel  were  computer  and  Air 
Force  maintenance  oriented. 
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2.  3  SYSTEMS  DATA  HISTORY  AND  AVAILABILITY 

Two  sources  of  data  have  been  used  as  a  base  for  problem  solving 
associated  with  SEDS.  Both  data  bases  are  related  to  Category  II,  F-111A 
aircraft  undergoing  tests  at  Edwards  Air  Force  Base,  California. 

The  first  source  used  was  hardware  oriented,  collected  by  mainte¬ 
nance  personnel  bn  the  "Maintenance  Discrepancy  Production  Credit 
Record,  "  AFSC  Form  258  (hereafter  referred  to  as  258  data,  see  Figures 
2;  3.  1  and  2.  3.  2).  This  form  is  used  for  recording  "on  equipment"  main¬ 
tenance  actions  and  includes  "Support  general"  work,  removal  and  rein¬ 
stallation  of  components,  fix-in-place  repair  actions,  installation  of  an 
item  when  accomplished  separately  from  the  removal  action,  recording 
functional  checks,  partial  job  completions,  trouble  shooting  actions,  etc. 
"Support .general"  and  "on  equipment"  maintenance  actions  are  not  to  be 
documented  on  the  same  form;. 

Each  report  in  the  258  system  is  considered1  to  be  a  line  item  record. 
There  were  il,  533  records  in  this  data  base,  dating  from  January  19&6 
through  September  1967. 

The  second  source  of  data  was  functionally  oriented.  These  data 
are  collected  from  the  pilots,  at  debriefing  after  each  flight  (see  Figures 
2'.  3. 3  and  2.  3. 4).  An  AFFTC  Form  0-294  is  used  to  record  satisfactory, 
degraded  or  malfunctioned  condition  of  each  functional  subsystem,  and  for 
each  phase  of  the  flight.  Each  functional  item  listed  has  a  4000  series 
number  to  identify  it  for  coding  purposes.  The  form  also  provides  for 
pilot's  comments. 

Each  report  in  the  debriefing  data  base  covers  approximately  200 
functional  bits  of  information.  There  were  37,  258  records  in  this  data 
base,  resulting  from  approximately  200  flights  from  January  1966  through 
September  1967. 

A  discussion  of  the  necessary  and  desirable  properties  of  a  data 
system  required  for  weapon  systems  effectiveness  studies  is  given  in 
Section  4.  0. 
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Figure  2.3.2.  Continuation  of  Sample  AFSC  258  Maintenance  Discrepancy/ Production' Credit  Record 
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3.  0  FORMATTED  FILE  SYSTEM 

The  Formatted  File  System  (FFS)  was  developed  for  the  Strategic 
Air  Command  as  an  Intelligence  Data  Handling  System  (see  SAC  contracts 
AF  19 (62 8)- 525  and  F  30(602)-67-C-0252).  It  provides  a  method  of  effi¬ 
cient  storage,  maintenance  and  retrieval  of  large  volumes  of  data  utilizing 
the  speed  of  large  scale  computers.  FFS  has  been  upgraded  over  the  past 
several  years,  to  the  current  version  or  model.  All  references  to  FFS  in 
this  document  are  to  version  eight  (FFS-V8).  In  general,  FFS  is  a  collec¬ 
tion  of  interrelated  IBM  70.94  computer  routines  capable  of  operating  on 
many  different  files  of  information.  Any.  data  which-can  be  described  as 
to  size  and  location  in  the  input  media  can  be  accommodated.  This 
description  of  the  data  becomes  a  part  of  the  data  base  and  serves  as  the 
control  for  file  processing. 

To  generate  a  file,  the  user  describes  the  file  to  the  system  in  the 
form  of  punched  cards.  This  description  includes  the  format  of  the  line 
items  (records)  in  the  file,,  the  various  input  formats  that  will  be  submit¬ 
ted  to  the  file  (10  maximum)  and  any  standard  output  formats  which  will 
be  required  from  the  file  (10  maximum).  This  description  may  be 
modified  at  any  time;  such  as  adding  or  deleting  fields,  and  the  data  base 
will  be  automatically  restructured. 

In  order  to  update  a  file  the  input  information  is  submitted  in  the 
form  of  punched  cards  or  magnetic  tape  with  a  control  card  indicating 
which  of  the  ten  available  input  formats  is  present.  When  updating,  'a  file 
look  up  operation  may  be  accomplished  automatically.  This  procedure 
introduces  data  into  line  items  according  to  matching  codes  in  the  input. 
Similarly,  modification  of  the  data  base  may  be  accomplished  by  submit¬ 
ting  revised  input  formats  or  retrieving  the  desired  line  items  and  specify¬ 
ing  changes  or  deletions. 

Retrieval  in  FFS  is  accomplished  by  specifying,  in  formatted 
English  statements,  a  set  of  criteria  associated  with  any  field,  portion  of 
a  field,  or  group  of  fields  in  the  data  base.  Processing  of  retrieved  data 
includes  sorting,  arithematic  operations,  totals,  subtotals,  averages, 
etc.  Output  report  generation  ranges  from  simple  statements  requesting 
standard  reports,  to  those  which  specify  the  exact  positioning  of  data 
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vertically  and  horizontally  in  the  output  report.  Graphic  output,  in  the 
form  of  point  and  bar  graphs,  are  also  available. 

3.  if  INITIAL  STATUS  OF  FSS 

When  the  SEDS  working  group^arrived  on  site  at  Edwards  AFB, 
.California,  the  IBM  Formatted  File  System  (FFS)  had  been  installed  as  a 
subsystem  under  IBSYS  on  an  IBM  7044/7094  Direct  Coupled  System 
(DCS).  Modified. FFS  documentation  and  information  describing  the  DCS 
operating;  system  were  made  available. 

Coordination  with  the  DCS  related  AF.FTC  personnel  revealed  the 
following  facts: 

.(•!);  FFS  required  modification  mainly  in  the  areas  of 
input/ output  unit  assignments  anddouble -precision 
to  single-precision  conversion. 

(2)  The  FFS  capabilities  of  File  Collation  and  Multi-file 
Query  were  not  available,  -since  the  disk  file  was  not 
attached  to  the  IBM  7094. 

(3)  The  System  Report  Program  of  FFS  was  hot  as  yet 
modified  for  operation  on  DCS. 

(4)  The  FFS  System  Graphic  Output  Program  was 
not.  installed. 


After  reviewing  the  available  documentation,  the  SEDS  working 
group  began  operations  with  the  data  tapes  transferred  from  Norton  Air 
Force  Base,  California. 

o  1  nn  r  rr\  ip  tt'-nt/-'*  7'r'TT‘D  TT  T"N 


As  might  be  expected  with  the  installation  of  a  system  the  size  of 
FFS,  several  problems  were  encountered.  The  following  is  a  brief  sum¬ 
mary  of  problems  experienced  by  the  SEDS  working  group. 

(1)  Any  task  which  required  more  than  one  history  tape 
to  be  entered  in  the  availability  table  of  FFS  failed. 

This  failure  was  due  to  an  error  in  the  FFS  System 
Input  Program.  Hence,  several  FFS  functions  requir¬ 
ing  more  than  one  history  could  not  be  performed. 

(2)  Attempts  to  produce  an  "ADD  tape"  by  means  of  the 
file  modification  process  (Type  12)  and  the  file  sum¬ 
marization  process  (Type  5)  both  failed.  When  cor¬ 
rected  the  "ADD  tape"  produced  could  not  be  used 

in  a  file  add  (FADD)  process. 
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(3)  File  updating  could  not  be  accomplished  due  to  the 
generation  of  an  illegal  tape  address  in  FFS.  After 
this  error  was  corrected,  it  was  found  that  ari-up- 
date  operation  failed  if  an  error  save  tape  was  pro¬ 
duced  since  the  tape  "rail  away"  in  the -update  process. 

In  addition,  .updating  from  tape,  as  bpposed-to  cards, 
was  not  possible  because  the  input  tape  was  not  cor¬ 
rectly  entered  in  the  FFS  System  Availability  Table. 

(4)  In  using  the.  Quick  Query  Function,  the  system  failed 
to  produce  a  diagnostic  indicating  an  imbedded  blank 
column  in  a  write  statement.  The  output  produced 
was  unusable. 

(5)  A  Type  4  file  summarization  process  could  not  be 
accomplished  because  a  portion. of.  the  File  Query 
Processor  Program  was  being  p ve r lay ed; during 
its  operation. 

(6)  File,  updating  employing  a  stored  FMUP  package 
(SMUP  function)  fails  and  provides a  diagnostic 
indicating  that  additional  tapes  are  required.  This 
conditions  also  occurs  on  a  Type  3  file  summari¬ 
zation  process. 

(T)  An  illegal  tape  address  diagnostic  has  caused  certain 
file  update  calculations  to  fail. 

3.3  CURRENT  STATUS  OF  THE  SYSTEM 

Many  of  the  problems  discussed  in  the  previous  section  have  been 
corrected  by  modifying  FFS  while  other  corrections  are  currently  imple¬ 
mented  through  the  use  of  octal  patches  submitted  with  the  appropriate 
jobs.  There  remain,  however,  problems  which  require  further  definition, 
and  analysis  to  define  the  program  in  error  and  specific  correction 
required.  The  following  is  a  list  of  known  errors  which  remain  outstanding: 

(1)  The  file  add  (FADD)  function. 

(2)  The  file  updating  function  when  an  error  save 
tape  is  generated. 

(3)  The  diagnostic  indicating  additional  tape  require¬ 
ments  in  SMUP  and  on  Type  3  file  summarization 
functions. 

(4)  The  diagnostic  "Illegal  Tape  Address"  on  certain 
FMUP  procedures  with  calculation. 

Additional  comments  can  be  found  in  Appendix  I. 
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4.  0  AIR  FORCE  MAINTENANCE  PHILOSOPHY 
AND  DATA  SYSTEM 


It  was  suggested  in  Section  1.  0  that,  if  the  effectiveness  of  a  weapon 
system,  is  to  be  considered,  it  is  reasonably  clear  that  reliability  and 
maintainability  histories  of  the  components  of  the  system,  should  be  avail¬ 
able.  Unfortunately,  it  is  not  obvious  what  questions  should  be  answered 
or  what  problems  should  be  solved  when  weapon  system  effectiveness  is 
considered.  If  such  questions  and  problems  could  be  formulated  precisely, 
there  still  remains  the  more  difficult  question  concerning  what  information 
is  needed  to  produce  reasonable  answers  to  weapon  systems  effectiveness 
questions.  The  Air  Force  approach  to  the  data  collection  problem  is  sum¬ 
marized  in  Sections  4.  1  through  4. .5  below. 

4.  1  INFORMATION  REQUIRED  FOR  SEDS 

The  information  required  to  answer  maintainability  questions  of  the 
type  given  in  Section  5.  0  are  related  to  the  following  considerations. 

(1)  A  method  of  linking  a  series  of  related  tasks  stemming 
from  an  original  maintenance  requirement  is  mandatory 
(original  Report  Number,  and  tracking  part  number/ 
serial  number  of  equipment). 

(2)  A  method  of  identifying  the  hardware  under  study,  is  also 
mandatory  (name,  part  number/  serial  number,  Work 
Unit  Code). 

(3)  Why  did  the  hardware  require  maintenance?  (How 
Malfunctioned  Code) 

(4)  When  did  the  maintenance  requirement  become  known? 

(When  discovered,  date  and  time) 

(5)  When  was  the  maintenance  requirement  discovered: 
during  other  maintenance,  during  inspection,  etc.  ? 

(When  Discovered  Code) 

(6)  How  long  did  it  take?  (Start/ stop  time) 

(7)  What  was  done  to  restore  the  hardware  to  its 
operating  state?  (Action  Taken  Code) 

The  above  terms  are  defined  in  the  description  of  the  management 
data  blocks  of  the  258  data  system. 


4-1 


4.2  AIR  FORGE  CONCEPT  OF  MAINTENANCE 

In  order  to  understand  the  type  of  data  elements  needed  for  main¬ 
tainability  studies,  it  is  necessary  to  review  the  Air  Force  concept  of 
maintenance.  Generally,  there  are  three  major  levels  of  maintenance  in 
the  Air  Force  which  are  known  as  Organizational,  Field,  and  Depot  with 
Organizational  Maintenance  divided  into  line  and  shop  maintenance 
respectively. 

Organizational  line  maintenance  activity  is  conducted  by  a  group  of 
personnel  who  are  charged  with  preflight,  postflight,  and  daily  inspections 
of  a  weapon  system.  The  personnel  are  usually  specialists  who  trouble- 
shoot  and  repair  malfunctions  by  using  a  block  replacement  policy  or  other 
easily  removed  and  replaced  items  on  the  equipment  which  have  been 
defined  as  "line  Replaceable  Units,  "  (LRU).  The  line  organization  also 
services  equipment  by  refueling,  lubricatingj  making  minor  adjustments 
and  calibrations  of  equipment  at  the  weapons  system  location  (such  as  the 
flight  line).  On  the  other  hand,  organizational. shop  activities  are  con¬ 
ducted  by  a  group  of  personnel  who  can  bench  check  most  of  the  LRU's 
removed  at  line  level.  Shop  personnel  may  remove  and  replace  sub¬ 
assemblies,  circuit  boards,  easily  removed  hardware,  lubricate  where 
necessary,  clean  equipment,  and  adjust  and  calibrate  to  shop  standard 
test  equipment.  More  detail  maintenance  ta?k$  are  referred  to  Field 
Maintenance  personnel  who  are  authorized  to  perform  major  maintenance, 
such  as  engine  overhaul,  removal  and  replacement  of  electronic  equipment 
to  the  component  level.  As  might  be  expected  field  maintenance  activities 
are  limited  by  quantity  and  quality  of  test  equipment  and  other  shop  facili¬ 
ties.  Finally,  equipment  that  cannot  be  repaired  atfield  level  maintenance 
is  shipped  to  a  depot  (the  "depot"  may  include  the  manufacturer).  The 
Field  Maintenance  Organisation  makes  appropriate  entries  to  maintenance 
forms  and  shipping  documents  with  a  "Not  Repairable  This  Station"  (NRTS) 
Action  Taken  code  from  the  Work  Unit  Code  Manual  (see  Table  4.2.  1). 

The  depot  may  then  completely  overhaul  and  rebuild  equipment  as 
necessary. 
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4.  3  DATA  SOURCES 


Data  collection  for  the  F-lll  Category  II  Testing  at  Edwards  AFB 
is  an  AFSC  adaptation  of  the  procedure  outlined  in  the  Air  Force  Mainte¬ 
nance  Management  Manual  (AF  Manual  66-1).  This  particular  data 
acquisition  procedure  is  known  as  the  258  Data  System  and  is  character¬ 
ized  by  AFSC  Forms  258  and  258-4.  AFSC  Form  258  is  a  single  copy 
form  used  for  recording  maintenance  actions  as  described  in  Section  4.  2 
above  and  likewise  for  the  four  copy  AFSC  Form  258-4;  The  format  of 
these  forms  are  identical.  In  order  to  keep  track  of  all  maintenance  tasks 
Coply  One  of  the  258-4  is  used  to  record  removal  and  replacement  of  all 
repairable/recoverable  items,  including  time  change  items,  or  removal 
accomplished  separately  from  replacement  action.  Copy  Two  is  used  as 
a  control  for  items  being  processed  within  the  maintenance  shop  to  report 
repair  cycle  information.  Copy  Three  is  used  to  report  bench  check. 

Copy  Four  is  used  to  report  repair  action  when  accomplished  separately 
from  bench  check. and  also  serves  as  a  reparable  tag. 

Coding  for  the  258  Forms  is  obtained  from  the  Air  Force  Technical 
Order  lF-lllA-°6  (for  the  F-lll  aircraft),  i.  e. ,  the  "Work  Unit  Code 
Manual.  "  This  manual  contains  "When  Discovered"  codes,  Table  4.3.  1, 
"How  Malfunctioned"  codes,  Table  4.  3.  2,  and  "Work  Unit"  codes,  Tables 
4.3.3  -  4.3.5.  All  these  codes  are  common  to  all  Air  Force  activities 
and  operational  equipment,  except  "Work  Unit"  codes.  The  latter  codes 
are  unique  to  each  weapons  system.  They  are  identified  in  specific  Work 
Unit  Code  Manuals  peculiar  to  each  v/eapon  system.  These  codes  are 
described  in  more  detail  below. 

The  management  data  blocks  of  the  258  system  forms  (Figure  2.3.  1) 
used  for  this  study  are: 

(1)  Report  Number  (PPRN):  This  is  a  unique  serial 
number  preprinted  on  each  form. 

(2)  Original  Report  Number  (ORN):  This  entry  is  the 
primary  key  to  track  and  tie  together  a  complete 
chain  of  events.  From  the  initial  report,  each  sub¬ 
sequent  line  or  shop  action  should  reflect  the  same 
ORN,  until  all  degraded  items  connected  with  the 
original  report  are  either  returned  to  service  or 
condemned. 


4-4 


Table  4.3.2.  How  Malfunctioned  Codes  Used  for  Maintenance  Activities 
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Source:  Work  Unit  Code  Manual  for  the  F- 


Table  4.3.4.  A  Sample  of  Work  Unit  Codes  for  Hydraulic 
and  Pneumatic  Power  Supply  for  the  F-lli 
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Source:  Work  Unit  Code  Manual  for  the  F-iil  (T.  O.  1F-111A-06) 
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The  PPRN  from  the  initial  report  should  be  transcribed  to  the  ORN 
block  of  the  initial  report  and  each  subsequent  258  series  form.  Genera¬ 
tion  of  additional  reports  is  necessary  when  more  than  one  item  is  worked 
on,  or  when  delays  in  maintenance  action  occur.  The  same -ORN  should 
appear  on  every  copy  of  every  report  stemming  from  the  original  discrep¬ 
ancy.  This  number  may  be  transcribed  to  the  ORN  block  from  previous 
reports  or  from  historical  records.  In  order  to  fix  ideas  consider  the 
follow:ing  example. 


(a)  The  right  turbo  engine  failed 
to  operate,  and  trouble 
shooting  has  started. 

(b)  The  center  section  access 
covers  were  removed  to  per¬ 
mit  inspection  of  engine. 

(c)  The  right  turbo  engine  was 
removed,  and  replaced  with 
a  new,  like  engine. 

(d)  The  access  covers  were  rein¬ 
stalled.  The  new  engine  was 
run  up,  checked  and  found 
satisfactory. 

(e)  The  engine  removed  from  the 
aircraft  was  bench  checked, 
and  a  compressor  rotor  found 
damaged. 

(f)  The  front  compressor  rotor 
was  removed  and  replaced 
by  a  serviceable  like  item. 

(g)  The  engine  was  reassembled, 
bench  checked  and  found 
serviceable. 

(h)  The  compressor  rotor  was 
bench  checked,  found  damaged 
beyond  repair  and  condemned. 


PPRN  1234 


PPRN  2345 

PPRN  3456 

PPRN  6543 


PPRN  4567 


PPRN  4567 

PPRN  4567 

PPRN  6789 


ORN  1234 

ORN  1234 

ORN  1234 

ORN  1234 

ORN  1234 

ORN  1234 

ORN  1234 

ORN  1234 


The  eight  maintenance  actions  above  make  up  one  complete  chain  of  events, 
all  tied  together  with  ORN  1234. 


(3)  Item  Identification:  This  identifies  the  weapons  system 

or  end  item  on  which  work  is  required  of  being  performed. 
Usually  this  is  aircraft  typte,  i.  e. ,  F-lllA. 

(4)  Serial  Number:  This  is  an  Air  Force  or  manufacturers 
serial  number  of  the  item  identified  above.  Usually  this 
is  an  aircraft  tail  number,  i.  e. ,  65-5701. 

(5)  Time /Cycles  or  Miles:  This  reflects  the  time,  to  the 
nearest  hour,  cycles  or  miles  of  the  end  item  {usually 
the  aircraft  listed  above).  This  information  is.  tran¬ 
scribed  from  historical  records  or  other  data  sources, 
such  as  running  time  meters. 

(6)  When  Discovered  Time:  This  is  the  day,  month,  year, 
and  hour  (to  the  nearest  five  minutes)  when  the  dis¬ 
crepancy  was  discovered.  Example:  03/08/67/1710 
for  3  August  1967  at  1710  hours. 

(7)  Date  This  Report:  The  day,  month,  and  year  on  which 
the  job  is  performed.  The  form  should  be  initiated 
the  same  day  that  work  was  accomplished, 

(8)  When  Discovered  Code:  This  is  the  approximate  code 
from  the  Work  Unit  Code  manual  that  identifies  when 
the  defect  or  need  for  maintenance  action  was  dis¬ 
covered  (see  Table  4.3.  1). 

(9)  Failed  Item  Manufacturer:  This  is  an  alpha-numeric 
code  identifying  the  manufacturer.  The  code  is 
extracted  from  Air  Force  supply  manuals  or  the 
Illustrated  Parts  Breakdown  of  the  failed  item, 

(10)  Failed  Item  Noun:  This  is  the  noun  which  best  des¬ 
cribes  the  failed  item  as  indicated  in  the  Work  Unit 
Code  Manual. 

(11)  Failed  Item  Serial  Number:  This  is  the  manufacturers 
serial  number  of  the  equipment  or  component  being 
removed,  obtained  from  the  item  data  plate. 

(12)  Failed  Item  Time  Cycles  or  Miles:  This  is  time  to 
the  nearest  hour,  cycles,  or  miles  of  the  failed  item. 

This  is  in  addition  to  the  Time,  Cycles  or  Miles  listed 
in  (5)  above.  This  entry  is  for  the  failed  item,  while 
the  entry  listed  in  (5)  is  for  the  aircraft  or  other  end 
item  from  which  it  is  removed. 
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(13)  Failed  Item  Part -Number:  This  is  the  part  number 
as  it  appears  oa  the  attached  data  plate,  or  from,  the 
parts  catalog.  Care  in  recording  this  number  is 
necessary,  as  this  is  another  key  in  tracking  a  com¬ 
plete  chain  of  maintenance  events. 

(14)  Work  Unit  Code  (WUC):  The  work  unit  code  is  also 
a  prime  key  to  tracking  maintenance  history. 

The  Work  Unit  Code  system  is  an  Air  Force  wide  technique  to  encode 
specific  hardware  items  to  facililafe  data  collection.  Analysis  of  these 
data  elements  may  be  used  to  evaluate  a  particular  maintenance  policy  or 
for  historical  and  logistic  purposes.  The  utility  of  the  Work  Unit  code  sys¬ 
tem  is  that  it  assigns  a  unique  code  to  each  component  or  assembly  within 
the  weapon  system,  regardless  of  manufacturer.  However,  these  codes 
are  not  universal  since  there  are  separate  manuals  for  each  aircraft  and 
missile  type.  Each  manual  has  its  own  technical  order  number,  the  first 
part  of  which  reflects  the  equipment  for  which  it  was  designed.  The  last 
part  of  the  number  is  usually  -06;for  example,  the  manual  for  the  F-111A 
is  Technical  Order  (T.  O.  1F-111A-06)..  They  are  generally  referred  to 
as  the  "dash  six  manuals.  "  Three  pages  from  T.  O.  1F-111A-06  WUC 
manual  are  shown  in  Tables  4.3.3  through  4.  3.  5.  Only  three  systems  .re 
reflected  in  the  above  tables,  the  airframe,  the  hydraulic  and  pneumatic 
power  supply,  and  the  bombing/navigational  equipment.  A  list  of  the 
other  systems  covered  by  the  -06  manual  are  shown  in  Table  4.  3.  6. 

With  reference  to  Tables  4.  3. 3  through  4.  3.  5,  the  first  two  digits 
of  each  Work  Unit  Code  designate  a  system.  For  example,  Airframe  is 
identified  by  system  Code  1  i,  Hydraulic  and  Pneumatic  Power  Supply  is 
identified  by  system  Code  45,  and  Bombing/ Navigational  equipment  is 
identified  by  system  Code  73.  The  third  indenture  or  digit  of  the  five  digit 
code  identifies  a  subsystem.  The  fourth  and  fifth  digits  designate  an 
assembly  and/or  specific  component.  For  example,  consider  work  unit 
code  1 1AAB  from  Table  4.3.3.  The  system  code  ii  identifies  the  air¬ 
frame.  The  subsystem  code  1 1A  identifies  the  nose  section.  The  radome, 
a  sub-indenture  of  the  nose  section,  is  coded  11AA.  The  specific  com¬ 
ponent  identified  by  Work  Unit  Code  1 1AAB,  is  the  radome  latch  assembly 
which  is  pari  of  the  nose  section  of  the  airframe.  As  a  second  example, 
consider  Work  Unit  Code  45ABC  from  Table  4.3.4.  This  is  a  bypass 
valve,  which  is  part  of  the  primary  hydraulic  reservoir  assembly. 
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SYSTEM  CODE 

DESCRIPTION 

01 

GROUND  HANDLING  AND  SERVICE 

02 

AIRCRAFT  CLEANING 

03 

"LOOK"  PHASE  OF  SCHEDULED  INSPECTIONS 

04 

SPECIAL  INSPECTIONS 

05 

AIRCRAFT  AND  INSTALLED  ENGINE  STORAGE 

06 

GROUND  SAFETY 

07 

PREPARATION  AND/OR  MAINTENANCE  OF 
AIRCRAFT  RECORDS 

08 

SPECIAL  WEAPONS  HANDLING  (MUNITIONS 
MAINTENANCE  SQUADRON  FACTIONS) 

09 

SHOP  SUPPORT 

11 

AIRFRAME 

12 

COCKPIT  AND  FUSELAGE  COMPARTMENTS 

13 

LANDING  GEAR 

14 

FLIGHT  CONTROL 

16 

ESCAPE  CAPSULE 

23 

TURBO  JET  ENGINE 

41 

AIR  CONDITIONING,  PRESSURIZATION,  AND 
SURFACE  ICE  CONTROL 

42 

ELECTRICAL  POWER  SUPPLY 

44 

LIGHTING  SYSTEM 

45 

HYDRAULIC  AND  PNEUMATIC  POWER  SUPPLY 

46 

FUEL  SYSTEM 

47 

OXYGEN  SYSTEM 

49 

MISCELLANEOUS  UTILITIES 

51 

INSTRUMENTS 

52 

AUTOPILOT 

61 

HF  COMMUNICATIONS 

63 

UHF  COMMUNICATIONS 

64 

INTERPHONE 

65 

IFF 

71 

RADIO  NAVIGATION 

73 

BOMBING  NAVIGATION 

74 

FIRE  CONTROL  SYSTEM 

75 

WEAPONS  DELIVERY 

76 

ELECTRONIC  COUNTERMEASURE 

96 

PERSONNEL  EQUIPMENT 

97 

EXPLOSIVE  DEVICES  AND  COMPONENTS 

Source:  Work  Unit  Code  Manual  for  the  F-lil  (T.  O.  2F-11A-06) 


(15)  How  Malfunctioned  Code  (HOW  MAL):  This  is  a  three  digit 
numerical  code  that  best  describes  the  nature  of  malfunction 
or  action  required  on  the  assembly  or  component  identified 
by  the  Work  Unit  Code,  These  codes  are  universal  through¬ 
out  the  Air  Force,  Each  code  has  identical  meaning, 
regardless  of  weapons  system  (See  Table  4.3,2). 
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(16)  Installed  Item  Noun:  Similar  to  failed  item  noun-  Applicable 
to  the  assembly  or  component  installed. 

(17)  Installed  Item  Serial  Number:  The  serial  number  from  the 
data:  plate  of  the  assembly  or  component  being  installed. 

(18)  Installed  Item  Time/Cvcles  or  Miles:  Time  to  the  nearest 
hour,  cycles  or  miles  extracted  from  historical  records. 

(19)  Installed  Item  Part  Number:  The  part  number  of  the  item 
being  installed  is  taken  from  its  data  plate,  or  parts 
catalogs.  This  number  will  not  necessarily  be  the  same  as 
the  Failed  Item  Part  Number,  due  to  other  manufacturer, 
or  later  model  components. 

The  AFSC  speciality  code  is  also  required.  This  is  a  numeric  code 
universally  used  throughout  the  Air  Force.  The  code  breaks  down  to 
career  field  (such  as  aircraft  electronics),  career  field  subdivision 
(such  as  communication),  skill  level,  i.  e. ,  apprentice,  mechanic, 
technician,  and  supervisor.  This  code  is  entered  to  reflect  the  person¬ 
nel  who  performed  the  work  or  corrected  the  malfunction.  Finally,  start 
and  stop  time  is  the  clock  time  to  the  nearest  five  minutes  when  the  work 
begin  and  when  the  work  v/as  either  completed  or  delayed. 

Several  other  blocks  of  data  are  contained  within  the  258  series 
forms,  but  are  not  utilized  in  the  performance  of  this  study. 

4.  4  MISSION  DEBRIEFING  DATA  ELEMENTS 

The  management  data  blocks  of  the  F-lil  Mission  Debriefing  Form 
AFFTC  0-294  (Figures  2.3.3  and  2.3.4  of  Section  2)  that  are  used  for 
this  study  are  the  following: 

(1)  Mission  Number:  The  mission  is  identified  by  a  serialized 
numeric  plus  the  aircraft  code  letter.  For  example:  014H 
is  the  14th  Category  II  flight  on  aircraft  773. 

(2)  Aircraft  Number:  The  last  three  digits  of  the  Air  Force 
Serial  Number  (tail  number). 

(3)  Date:  Day,  month,  and  year  the  flight  was  completed. 

(4)  Type  Mission:  This  is  a  three  digit  code  for  the  mission 
performed,  such  as  ferry,  loiter,  or  intercept. 

(5)  Actual  Duration:  Hours  and  minutes  of  the  completed 
mission. 
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(6)  LH  and  RH  AB  time:  This  is  the  hours  and  minutes  the 
right  or  left  hand  afterburners  were  used. 

(7)  Number  of  Landings:  Total  number  of  landings  during  the 
entire  mission,  including  touch  and  go  landings. 

(8)  Wing  Sweeps:  Number  of  times  wings  were  swept  from 
forward  to  delta  position. 

(9)  Card  Number:  This  is  a  4000  series  number  assigned^to 
each  function,  i.  e.  : 

Card  Number  System 

4001  Airframe 

4028  Fuel  Transfer 

4096  Cabin  .Air  Conditioning 

4135  Terrain  Following  Radar 

There  are  a  total  of  180  of  the  4000  functional  codes. 

(10)  Phase  of  Flight:  There  are  twelve  phases  of  flight  making 
up  a  matrix  for  each  of  the  180  functional  codes.  They 
include  Pre-start  inspections,  take-off  and  acceleration, 
cruise  and  landing  phases. 

An  entry  is  made  for  each  phase  of  the  total  mission  using  the  alpha 
characters  within  functional  code: 

S  Satisfactory 

D  Degraded  performance 

(Equipment  still  usable) 

F  Failure 

K  Uncleared  Discrepancy 

It  is  assumed  that  when  a  matrix  block  is  left  blank,  the  equipment  was 
not  checked  or  used  during  that  phase  of  flight.  For  example,  these 
functions  may  have  behaved  in  the  following  manner: 


Card 

Number 

System 

Pre- 

Start 

Taxi 

Take 

Off 

Cruise 

Landing 

Discrepancy 

4060 

Flight  Control, 
Yaw 

S 

S 

S 

D 

Controls 

Stiff 

4084 

Intercom 

S 

S 

F 

F 

Mike  broken 

4105 

Instruments 

K 

D 

D 

D 

D 

Air  Temp. 
Indicator 
glass  cracked 
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4.  5  PROBLEMS  WITH  THE  258/MISSION  DEBRIEFING  DATA  SYSTEM 

The  concept  of  designing  and  implementing  a  general  purpose  data 
base  for  weapon  systems  effectiveness  analysis  is  very  complex.  A 
variety  of  problems  are  expected  when  an  experimental  data  system  is 
implemented.  Usually,  data  system  problems  identify  inconsistencies 
in  the  initial  design  and  their  solutions  tend  to  suggest  ways  for  improving 
the  system.  In  this  section,  some  of  the  problems  encountered  while 
using  the  258/Mission  Debriefing  Data  System  are  iuentified. 

It  should  be  recognized  that  the  258  Data  System  and  the  Mission 
Debriefing  Data  System  are  dissimilar  but  supplemental,  since  the  258 
data  are  hardware  oriented  while  the  debriefing  data  are  functionally 
oriented.  Thus,  a  one  to  one  cross  reference  is  impossible.  Moreover, 
a  component  identified  by  its  Work  Unit  Code  may  effect  several  functions 
within  the  weapon  system.  Similarly,  a  failure  of  one  function  often 
requires  trouble-shooting  and  replacement  of  several  hardware  com¬ 
ponents,  each  having  its  own  Work  Unit  Code,  before  the  function  is 
restored  to  its  operating  state.  Thus,  if  the  Original  Report  Number 
(ORN).  is  not  entered  correctly  on  each  258  Form  which  is  related  to  the 
above  maintenance  tasks,  then  the  tracking  of  all  tasks  associated  with  a 
particular  maintenance  event  will  be  very  difficult.  Another  area  of  diffi¬ 
culty  is  the  inconsistency  between  ACTAK,  HOW  MAL  Co c  2S  and  Cor¬ 
rective  Action  Narrative.  Other  areas  of  difficulty  are  unidentifiable 
Work  Unit  Codes,  inconsistencies  between  stop  and  start  times  and 
missing  information. 

Obviously,  many  of  the  above  problems  could  be  resolved  through 
more  adequate  training  of  personnel  in  order  to  acquaint  them  with  the 
proper  record  completion  procedures.  Finally,  maintenance  personnel 
must  understand  the  importance  of  correct  entries  in  the  data  system, 
since  otherwise  the  data  will  be  meaningless  and  weapon  system  effec¬ 
tiveness  analysis  will  be  impossible. 
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5.  0  ANALYTI ZAL  PROBLEMS  FOR  F- 1  ii  CRITICAL  LRU 


A  weapon  system  must  be  reliable  and  maintainable  in  order  to  be 
an  effective  weapon  system  as  far  as  mission  requirements  are  con¬ 
cerned.  Since  the  military  must  plan  for  an  immediate  availability  of 
weapon  systems  in  case  of  a  national  emergency,  delays  due  to  weapon 
system  malfunction  or  failure  are  not  desirable.  Thus,  it  is  now  realized 
that  the  maintainability  of  a  weapon  system  is  at  least  as  important  as  its 
reliability.  Hence,  maintenance  policies  have  been  introduced  to  assure 
the  required  availability  cf  weapon  systems.  A  maintenance  policy  which 
appears  to  satisfy  the  immediate  availability  for  weapon  systems  is  one 
which  requires  block  replacement,  i.  e. ,  when  a  part  fails  the  entire  unit 
containing  that  part  is  replaced  and  the  removed  unit  is  sent  off  site  (to 
maintenance  shop  or  depot)  for  repair.  In  Air  Force  terminology  such  a 
unit  is  called  a  Line  Replaceable  Unit  (L-tU).  Obviously,  such  a  policy 
reduces  the  down  time  of  the  weapon  system  provided  the  necessary 
spares  are  available.  In  reality,  the  actual  maintenance  and  spares 
requirements  cannot  be  predicted  in  advance.  Thus,  it  becomes  neces¬ 
sary  to  estimate  these  requirements  from  observations  made  on  the 
weapon  system.  But  in  many  situations  it  is  impossible  to  obtain  accu¬ 
rate  estimates  due  to  insufficient  data.  On  the  other  hand,  if  sufficient 
data  are  available  certain  analytical  problems  must  be  solved  in  order 
to  obtain  meaningful  maintainability  information  from  such  data. 

With  the  cooperation  of  the  F-lil  Provisioning  Team,  General 
Dynamics  Corporation,  Fort  Worth,  Texas,  and  the  Air  Force  Logistic 
Command  (AFLC),  McClellan  AFB,  Sacramento,  California,  the  follow¬ 
ing  four  problems  were  identified. 

(1)  The  distribution  of  maintenance  events  for  eleven  LRU's 
on  the  F-lil  that  AFLC  considered  to  be  critical. 

(2)  The  relationship  between  replacement  and  failure  indi¬ 
cations  for  each  Critical  LRU. 

(3)  The  estimated  replacement  for  each  Critical  LRU  for  ten 
mission  types  specified  for  the  F-iil. 

(4)  The  evaluation  of  current  replacement  estimates  for  each 
Critical  LRU. 


In  this  report  solutions  are  provided  for  the  above  problems  based  on  the 
F-lll  Category  II  Test  Data  from  Edwards  AFB,  California. 

5.  1  IDENTIFICATION  OF  F-ill  CRITICAL  LRU'S 
AND  THE  CURRENT  PROCUREMENT  BASIS 

If  the  availability  requirements  for  the  F-lll  are  to  be  satisfied, 
the  maintenance  policy  for  this  aircraft  must  minimize  down  time  due  to 
malfunction  and  failure  of  system  components,  etc.  Thus,  in  order  to 
assure  with  high  probability  that  the  F-lll  will  meet  its  availability 
requirements  accurate  estimates  of  the  spares  requirement  for  this  air¬ 
craft  must  be  available.  In  this  regard,  eleven  Critical  LRU's  for  the 
F-lil  were  identified  by  AFLC  for  analysis.  These  units  are  listed  in 
Table  5.  1.  1  with  their  respective  cost  and  current  K-value  (maintenance 
factor).  The.  Krvalue  given  in  Table  5.  1.  1  is  the  current  estimated 
replacements  per  100  flying  hours  by  AFLC.  Thus,  each  LRU  under  con¬ 
sideration  is  provisioned  on  the  basis  of  its  K-value.  If  the  K-value  for 
a  particular  LRU  is  too  small,  then  that  unit  will  be  under  provisioned 
which  reduce  the  chance  of  satisfying  the  availability  requirements.  On 
the  other  hand,  if  the  K-value  for  a  particular  LRU  is  too  large,  then 
that  unit  will  be  over  provisioned  which  requires  the  expenditure  of  unnec¬ 
essary  funds.  Thus,  it  is  important  to  estimate  the  probability  distribu¬ 
tion  of  K  for  each  LRU  given  the  mission  profile  so  that  the  risk  of  not 
satisfying  the  spares  requirement  can  be  determined.  This  particular 
problem  is  considered  in  Section  5.4. 

5.  2  THE  DISTRIBUTION  OF  MAINTENANCE  EVENTS 
FOR  EACH  CRITICAL  LRU 

It  was  shown  in  SAMSO  Report  67-12  that  man -hours -to -repair  the 
actual  hardware  as  well  as  time  to  failure  or  time  between  failure  for 
subsystems  of  the  F-lll  Category  II  Test  Data  can  be  fitted  to  certain 
standard  probability  distributions  automatically.  In  this  section,  the 
distribution  of  the  total  time  associated  with  maintenance  events  for 
Critical  LRU's  of  interest  from  the  F-111  Category  II  Test  Data  is 
considered. 

Definition  5.2.1 :  The  administrative  and  technical  activities  associated 

with  the  restoration  of  a  device,  to  its  operating  state 
is  said  to  be  a  maintenance  event. 


Replaceable 


> 

i  © 


O  00 

A: S  £ 
w  P  ^ 


O  O  to 

in  o  to 

t-  m  to 


o  vo  m 

o  vo  r- 

O  vO  oo 


o  to 
o  to 
o  to 


%o  p- 
O  00 


o  o 

O  vO 

o  m 

•k  #» 

m  o 

CM 

40-  «5- 


m  o 
vO  m 

o  oo 

«»  o 

oo 

O' 

•yj-  y*- 


pj 

W 

H 

*  a 


I  r*» 

fl  sh  E 
o  ^  H 

a  9  a 

&  9  a 

u  §2 

o  Ho 

S  $U 
«  «K 

as 


3  a 

6  §• 


g  9 
5  « 


w  tv'  r; 

p|  ^  w 

a  w  n 

L  H  £ 

H  bl  § 


n  w  ffi 

ago 

/>  y 


-u  C 

g.  s 

P  T3  T}1 
*  0  ^ 
H  O  I 


U  H  co 


<5  0  0 

PQ  <1  Ph 

<  u  •  p 

CO  CO 
^  N  t' 

u  o  u 

a  p  p 

£  I*  £ 


P{  w 
,P<  o 

pjg 

sg  a 
ss  g 
1 1  to 

9«  0<5 

Sh  up 


<  , 

CO  M 

^  o 

2  aJ 

5  H 

S  z 


3  3 

«  a 
2  . 

W  Pi 
co  a 

*•  p 

a  Bj 

3  o<i 


2 

8 

a 

H  | 

w 

Z  w 

f  rn 


<  * 

9  & 

3  H 

H  1 

«  m 
<  w 
h  w 

co  A 


0 

< 

Pt 

<3 

0 

<3 

p 

< 

« 

U 

< 

P 

m 

« 

n 

<5 

< 

<3 

CO 

<M 

<M 

(M 

CO 

CVJ 

m 

m 

in 

in 

U 

U 

U 

U 

U 

U 

P 

P 

P 

P 

P 

P 

£ 

£ 

£ 

£ 

£ 

£ 

Force  Logistic «  Command,  McClellan 


Obviously,  a  maintenance  event  may  consist  of  a  series  of  activities  such 
as  repair,  test,  or  preventive  maintenance.  In  this  section,  the.  results 
of  problem  (1)  are  given.  Details  and  definitions  are  given  in  Appendix  II 
so  that  the  interested  reader  can  apply  this  type  of  analysis  to  similar 
problems  of  interest.  For  convenience,  several  of  the  basic  definitions 
are  given  below. 

Let  T  denote  active  hours,  elapsed  hours  or  man-hours  to 
restore  a  particular  LRU  to  its  operating  state.  When  T  includes  trouble¬ 
shooting  time,  delay  time  due  to  shortage  of  parts,  transportation,  or 
other  nonrelated  factors,  as  well  as  the  actual  time  to  restore  the  LRU 
to  its  operating  state,  then  T  denotes  the  elapsed  hours  associated  with 
that  maintenance  activity.  On  the  other  hand,  when  T  includes  only  the 
actual  hours  to  restore  the  LRU  to  its  operating  state,  then  T  denotes  the 
active  hours  associated  with  that  maintenance  activity.  Finally,  if  T  is 
the  time  required  for  maintenance  personnel  to  restore  the  LRU  to  its 
operating  state,  then,  obviously,  T  denotes  the  man  hours  associated 
with  that  maintenance  activity. 


To  fix  ideas  let  t^,  t^,  ...»  t^  denote  the  history  of  active  hours, 
or  etc. ,  to  restore  a  particular  LRU  of  the  F-lll  to  its  operating  state. 
Let  t^,  •  •  •  ?  denote  the  ordered  L's,  then  by  definition 


0:  If  t  <  t 


(1) 


Sn(t)  ~\n:  K  t(k)  <t-t’(k+  1);  k  "  2’  *•*»  n_1 

I:  Ht>t(n) 


(5.2.  1) 


is  the  sample  distribution  function  for  the  above  history  of  active  hours, 
etc.  In  (5.  2.  1)  k  denotes  the  number  of  t^'s  within  the  range  (t^, 
t^)*  Schematically,  the  sample  distribution  function  for  five  ordered 
t^j's  may  be  represented  by  the  step  function  in  Figure  5.  2.  1. 

From  a  theoretical  point  of  view  any  function  F  with  the  follow¬ 
ing  properties  is  said  to  be  a  distribution  function 


(i)  F(-cc)  =  0, 

(ii)  F(t)  is  non-decreasing  for  -«><  t  <  co, 

(iii)  F(oo)  =  1. 
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In  the  continuous  case  a  random  variable  T  may  be  defined  in  terms  of 
its  density  function.  Hence,  any  function  f  with  the  properties 


(i)  f(t)  >  0,  -co  <  t  <  oo 

oo 

(ii)  (*  f(t)  dt  =  1 

-CO 


can  serve  as  a  density  function  of  the  continuous  random  variable  T  and 
we  define 

t 

F(t)  =  J  f  (x)  dx  =  Pr  (T  <  t)  (5.2.2) 

-co 


to  be  distribution  function  of  T.  Obviously,  t  >  0  since  T  is  time.  Since 
the -functions  which  characterize  the  log  normal,  exponential  and  Weibull 
distributions  satisfy  the  above  requirements,  the  following  definitions 
are  given. 


Definition  5.  2.  1  (Log-Normal):  If  the  random  variable  T  is  such  that 
"  “  T'  =  logg  (T)  has  the  density 


f  (t*  |p,  or) 


(5.2.3) 


-oo  <  t1  <oo,  where  p  and  cr  denote  the  mean  and 
variance  of  T1,  then  T  is  said  to  be  log-normal 
with  mean 


m  =  E(T)  =  exp(|x  +  or  /2) 


(5.2.4) 


and  variance 


VAR(T)  =  exp 


|2(p  +  <r^)  j  -exp|2(x  +  cr^j 


(5.2.  5) 
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Definition  5.  2.  2  (Exponential): 


A  random  variable  T  is  said  to  be  dis¬ 
tributed  as  an  exponential  distribution 
with  parameter  X  if  its  density  is 

f(t  j  X.)  =  X  exp  (-Xt)  •  (5.  2.  >q) 


Definition  5.  2,  3  Weibull:  A  random  variable  T  is  said  to  be  dis¬ 

tributed  as  a  Weibull  distribution  with 
P  and  X  if  its  density  is 

f(t  |  p,  X*)  =  pxV-  Aexp  (-x¥)  •  (5.  2. 7) 

In  Appendix  II  the  Kolmogorov-Smirnov  statistic  is  used  to  compare 
S  (t)  with  the  above  probability  distributions  in  order  to  determine  which 
family  of  probability  distributions  Sn(t)  is  most  likely  to  be  a  member  of. 
The  Kolmogorov-Smirnov  statistic  is  denoted  by  the  quantity 

D  =  Sup  |  S  (t)  -  F(t)|  (5.2.8) 

n  tr  .i 

which  is  the  maximum  vertical  distance  between  the  graphs  of  F(t)  and 
Sn(t)  over  the  range  of  possible  t  values  ^see  Figure  5.2.  1). 

The  results  are  as  follows: 

(1)  Shop  active,  elapsed  and  man  hours  for  Critical  LRU  - 
Transmitter/Receiver,  WUC  73CAO,  are  more  likely  to  be 
distributed  as  a  log-normal  distribution  whose  logarithm 
is  normally  distributed  with  mean  t1  =  1.  40  and  variance 
s^,  =  1.  17,  t1  =  2.  11  and  s^,  =  4.28,  t1  =  1.  89,  and 

s£,  =  1.33  respectively  (see  Table  1  and  Figures  1  through 
9  iii  Appendix  II). 

(2)  Line  active,  elapsed  and  manhours  for  Critical  LRU  - 
Transmitter/Receiver,  WUC  73CAO,  are  more  likely  to  be 
distributed  as  a  log-normal  distribution  v/hose  logarithm 
is  normally  distributed  with  mean  t 1  =  1.  05  and  variance 


5-7 


st,  =  0.87,  t1  =  2. 35  and  sAl  =  2.02,  t"  =  1.62  and 
s£,  =  i.  76  respectively  (see  Tabic  2  and  Figures  10 
through  18  in  Appendix  £[}. 

(3)  Shop  active  and  elapsed  hours  for  critical  LRU  -  Modulator, 
Receiver/Transmitter,  WUC73BDO,  are  more  likely  to  be 
distributed  as  a  log-normal  distribution  whose  logarithm  is 
normally  distributed' with  mean  t!  =  1.  56  and  variance 

s^,  =  1.  30,  V  =  1.91  and  =  1. 74  respectively.  However, 
shop  man  hours  for  the.  above  LRU  are  more  likely  to  be 
disbributed  as  an  exponential  distribution  with  parameter 
X  =  0.  0685  (see  Table  3  and  Figures  19  through  27  in 
Appendix  II). 

(4)  Line  active,  elapsed  and  man  hours  for  Critical  LRU  - 
Modulator,  Receiver/Transmitter,  WUC73BDO,  are  more 
likely  to  be  distributed  as  a  log-normal  distribution  whose 
logarithm  is  normally  distributed  with  mean  t1  =  1.  07  and 
variance  s^,  =  0. 32,  t1  =  2. 62  and  s^,  =  2.  52,  t1  =  1.  94 
and  s“  =  0.  34  respectively  (see  Table  4  and  Figures  28 
through  36  in  Appendix  II). 

(5)  Shop  active  and  man  hours  for  Critical  LRU  -  Stabilization 
Platform,  WUC  73AAO  are  more  likely  tc  be  distributed  as 
a  Weibull-distribution  with  parameters  p  =  1.  1430  and 

X*  =  0.  0601,  p  =  1.  07 10  and  X'r  =  0.  0334  respectively. 
However,  shop  elapsed  hours  for  the  above  LRU  are  more 
likely  to  be  distributed  as  a  log-normal  distribution  whose 
logarithm  is  normally  distributed  with  mean  t1  =  3.  12  and 
variance  s^,  =  4.42  (see  Table  5  and  Figures  37  through  45 
in  Appendix  II). 

(6)  Line  active  and  elapsed  hours  for  Critical  LRU  -  Stabilization 
Platform,  WUC  73AAO  are  more  likely  to  be  distributed  as 

a  log-normal  distribution  whose  logarithm  is  normally 
distributed  with  mean  t1  =  1.  44  and  variance  s^,  =  0.  67, 
t1  =  2.74  and  s^,  =  2.54  respectively.  However,  line  man 
hours  for  the  above  LRU  are  more  likely  to  be  distributed  as 
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a  Weibull  distribution  with  parameters  =  1.3700  and 
X*  =  0.  03 13  (see  Table  6  and  Figures  46  through  54  in 
Appendix  II). 

(7)  Shop  active  hours  for  Critical  LRU  -  Navigational  Computer 
CP812/AJQ-20,  WUC  73 ABO,  are  more  likely  to  be  distri¬ 
buted  as  an  exponential  distribution  with  parameter 

X  =  0. 126?.  But  here  a  Weibull  distribution  with  param¬ 
eters  $  =  1. 16 00  and  Ik.*  =  0.  0887  fits  the  data  equally 
well.  However,  shoj.,  elapsed  hours  for  the  above  LRU  are 
more  likely  to  be  distributed  as  a  log-normal  distribution 
whose  logarithm  is  normaUy  distributed  with  mean  t(  =  1.  95 
and  variance  s£,  =  2.  98.  Finally,  man  hours  for  the  above 
LRU  are  more  likely  to  be  distributed  as  a  Weibull  distri¬ 
bution,  with  parameters  $  =  1.  1760  and  =  0.0351  (see 
Table  7  and  Figures  55  through  62  in  Appendix  II). 

(8)  Line  active  arid  man  hours  for  Critical  LRU  r  Navigational 
Computer  CP812/AJQ-20,  WUC  73ABO,  are  more  likely  to 
be  distributed  as  a  Weibul  distribution  with  parameters 

{J  =  1.2280  and  £*  =  0.1135,  $  =  1.  1030  and  £*  =  0.  0615 
respectively.  However,  line  elapsed  Hours  for  the  above 
LRU  are  more  likely  to  be  distributed  as  a  log-normal 
distribution  whose  logarithm  is  normally  distributed  with 
mean  t*  =  2.  51  and  variance  s£,  =  4.  00.  Here  a  Weibull 
distribution  with  parameters  $  =  0.  5920  and  X*  =  0.  1259 
fits  the  data  equally  well  (see  Table  8  and  Figures  63 
through  71). 

Unfortunately,  the  remaining  Critical  LRU's  listed  in  Table  5.  1.  1 
in  Section  5.  1  had  insufficient  data  for  the  above  type  of  analysis.  How¬ 
ever,  it  is  important  to  recognize  that  as  the  F-ill  Category  II  Testing 
continues  the  data  base  upon  which  this  analysis  is  based  will  increase, 
thereby  providing  additional  maintenance  history  for  the  above  LRU's. 
Obviously,  at  that  point  in  time  Sn(t)  for  those  LRU's  with  sufficient  data 
should  be  recomputed  and  the  above  analysis  repeated.  In  fact,  such 
analysis  should  be  carried  out  periodically  in  order  that  the  availability 
and  maintainability  estimates  for  the  F-lil  will  be  based  on  the  current 


field  or  operational  experience  of  the  aircraft.  For  additional  comments 
see  Section  5. 6  below  and  Appendix  1L 

5.3  THE  RELATIONSHIPS  BETWEEN  REPLACEMENTS 
AND  FAILURE  INDICATIONS  DURING  F-ill 
CATEGORY  H  TESTING 

It  is  well  known  that  accurate  estimates  of  the  spares  requirements 
for  a  weapon  system  cannot  be  determined  unless  the  failure  and  replace¬ 
ment  histories  of  the  system  components  can  be  related.  An  obvious 
relationship  is  a  one  to  one  correspondance  between  a  failure  indication 
and  a  replacement,  i.  e. ,  for  each  failure  indication  a  replacement  is 
required.  The  above  relationship  between  failure  indications  and  replace¬ 
ments,  obviously,  defines  an  "upper  bound  relationship."  On  the  other 
hand,  if  no  replacement  is  required  for  each  failure  indication,  a  "lower 
bound  relationship"  is;  indicated.  Clearly,  the  most  likely  relationship 
between  failure  indications  and  replacements  must  lie  somewhere  between 
these  two  extremes.  In  order  to  find  such  a  relationship,  the  notion  of  a 
failure  indication  and  a  replacement  must  be  made  more  precise. 

Definition  5. .3.  1:  Any  maintenance  activity  with  a  repair  type  "action 

taken  code"  (ACTAK)  and  a  defective  type  "how 
malfunctioned  code"  (HOW  MAL)  is  said  to  be  a 
failure  indication. 

For  a  detailed  definition  of  the  above  ACTAK  and  HOW  MAL  codes 
see  the  Air  Force,  Work  Unit  Code  Manual  (T.  O.  1F-111A-06).  Line  and 
shop  activities  have  been  separated  in  the  ensuring  analysis: 

Definition  5.  3.  2:  The  exchange  of  an  identical  LRU  on  an  aircraft  is 

said  to  be  a  line  replacement. 

In  passing  it  is  mentioned  that  a  shop  replacement  is  required  when 
an  LRU  removed  from  an  aircraft  is  condemned  or  transferred  off  base 
for  repair.  In  this  section  a  solution  is  given  for  problem  (2)  based  on 
failure  indications  and  line  replacements. 

til 

Suppose  T^  is  the  time  measured  in  hours  that  the  i  aircraft.has 

been  in  Category  II  Testing  and  let  t  £  T  be  a  fixed  number  of  hours, 

where  i  =  1,  2,  ...,  N  aircrafts.  Then  for  the  m.  =  T./t  time  intervals 

tli  ^  ^ 

of  t  hours  or  less  that  the  i  aircraft  has  been  in  Category  II  Testing, 


consider  the  number  of  failure  indications  and  replacements  in  each  of 

these  3TL  intervals  for  a  particular  LRU.  For  convenience  let  n.(F)  and 

n.(R)  denote  the  number  of  failure  indications  and  replacements  for  the 
3  th 

LRU  under  consideration  for  the  i  aircraft  in  each  of  the  m.  intervals. 

th  1 

Hence,  for  each  time  interval  the  i  aircraft  is  in  Category  II  Testing  a 

pair  of  number  (n.{Fj  ,  n.(R))  are  generated  for  that  LRU,  where 
J  J 

n.(R)  <  n_(F)  since  the  number  of  replacements  can  never  exceed  the  num¬ 
ber  of  failure  indications  in  any  interval.  Thus,  for  any  LRU  of  interest 
on  the  i  aircraft  a  sequence  of  pairs  of  numbers  (n.(F)  ,  n.(R)), 
j  =  1,  *  •  •  ,  m.  are  generated.  Repeating  this  procedure  for  each  of  the 
N  aircrafts,  nij  +  +  *  *  *  +  such  pairs  of  numbers  are  generated 

for  any  LRU  of  interest.  When  these  pairs  of  values  are  plotted  in  the 
n(F)  x  n(R)  -  plane  a  scatter  plot  similar  to  Figure  5.3.  1  is  generated. 
The  number  associated  vtdth  each  point  on  Figure  5.  3.  1  represents  the 
frequency  with  which  that  number  of  failure  indications  and  replacements 
were  observed  over  each  time  interval  and  each  aircraft  for  the  Naviga¬ 
tional  Computer. 


Figure  5.3.  2  gives  the  result  of  fitting  a  straight  line  to  the  data 
points  in  Figure  5. 3.  i.  The  line  E^(N(R)  |  N(F))  denotes  the  relationship 
between  replacements  and  failure  indications  when  the  outcome  of  a  failure 
indication  could  not  be  identified  as  a  repair  or  a  replacement,  in  such 
situations,  it  was  assumed  that  a  replacement  was  required  when 
E  j(N(R)  |  N(F))  was  computed.  On  the  other  hand,  when  the  line 
E2(N(R)  |  N(F))  was  computed  it  was  assumed  that  no  replacement  was 
required.  It  should  be  recognized  that  the  closeness  of  these  two  lines 
gives  error  bounds  on  the  consistency  of  the  data  collection  for  this  par¬ 
ticular  LRU.  Obviously,  the  line  which  gives  the  best  estimate  of  the 
true  relationship  for  this  LR_U  cannot  be  determined.  However,  it  is 
reasonably  certain  that  the  best  estimate  lies  between  these  two  lines. 

The  relationships  for  the  remaining  LRU's  are  summarized  in  Table  5.3.  1. 
Additional  comments  on  this  problem  can  be  found  in  Appendix  III. 
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NUMBER  OF  FAILURE  INDICATIONS  PER  1000  CALENDAR  HOURS 


Figure  5.  3 


.2:  The  relationship  between  replacements  and  failure 
indications  per  1000  calendar  hours  for  Critical 
LRU  -  Navigational  Computer,  WUC  73ABO,  for 
seven  F- Ill's  in  the  Edwards  AFB  Category  II 
Testing  Program. 
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Source:  258  Data  System  for  the  F-lll,  Edwards  AFB,  California. 


5.  4  ESTIMATED  RE  PLACEMENTS  FOR  EACH  MISSION  TYPE 

It  is  well  known  that  spares  requirements  for  weapon  systems  whose 
life  span  extends:  beyond  a  single  mission  are  based  on  the  estimated 
replacement  rate  per  unit  operating  time,  where  time  is  usually  measured 
in  hours.  For  the  F-ili  the  procurement  of  spares  are  based  on  the 
estimated  replacement  rate  per  100  flying  hours  which  was  denoted  in 
Section  5.  i  as  the  K-value  (maintenance  factor);  Here  a  different  approach 
is  considered;  First,  it  is  well  known  that  certain  pieces  of  hardware  in 
a  weapon  system  remain  in  an  operating  state  during  a  complete  mission 
even  though  the  mission  profile  only  requires  their  operation  at  specified 
time  intervals  during  the  mission.  Generally,  missions  assigned  to  a 
particular  weapon  system  varies  in  time  duration,  where  the  time  duration 
of  each  mission  type  is  known.  Obviously,  different  mission  types  may 
require  different  pieces  of  hardware.  Thus,  it  is  extremely  difficult  to 
determine  the  actual  operating  time  on  certain  pieces  of-hardware.  On 
the  other  hand,  it  is  predetermined  whether  a  particular  piece  of  hardware 
is  required  for  a  given  mission  type.  Moreover,  the  duration  of  the  mis¬ 
sion  is  specified  by  its  type.  Thus,  it  follows  that  the  replacement  rate 
per  mission  type  can  be  used  as  the  basis  for  a  procurement  policy.  In 
this  section  the  estimated  replacements  per  mission  type  as  well  as  per 
100  flying  hours  are  given. 

The  re  liability/ maintainability  sample  mission  profiles  for  the  F-lll 
Category  II  Testing  at  Edwards  AFB  are  given  in  Table  5.4.  1.  In  general, 
the  analytic  problem  of  estimating  replacements  per  mission  type  is 
solved  once  the  regression  lines  in  Table  5.  3.  1  are  available  and  the 
mission  profiles  in  Table  5.4.  1  are  specified.  Here  the  requirement  is  to 
redefine  the  calendar  time  interval  of  length  t  hours  of  Section  5.3  to  be 
the  duration  per  mission  type  of  Table  5.  4.  1.  Then  N(F)  and  N(R)  become 
the  number  of  failure  indications  and  the  number  of  replacements  per  mis¬ 
sion  type  respectively.  However,  it  is  recognized  that  N(F)  and  N(R)  are 
now  based  on  the  mission  debriefing  data  elements  of  the  258/ Mission 
Debriefing  Data  System.  From  Section  4.  5  it  is  known  that  the  258  Data 
System  and  the  Mission  Debriefing  Data  System  are  dissimilar,  since  the 
258  data  are  hardware  oriented  while  the  debriefing  data  are  functionally 
oriented.  Thus,  when  a  functional  failure  indication  is  observed  it  is  no 
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Table  5.4.  1.  Reliability/ Maintainability  Sample 
Mission  Profiles  for  the  F-lll 


•J  t  , 

Mission 

Type  No. 

Approximate 

Hour  s/ Mis  s  ion 

Profile 

1 

■i.0  HOUR 

LO  -  LO  -  LO  -  LO 

2 

1.  5  HOURS 

LO  -  LO  *  j_iO  —  1*0 

3 

3.  5  HOURS 

LO  -  LO  -  HI 

4 

2.  5  HOURS 

LO  -  LO  -  HI 

5 

1.  5  HOURS 

LO  -  LO  -  HI 

6 

5.  0  HOURS 

HI  -  LO  -  HI 

7 

10.  0  HOURS 

FERRY 

8 

7.  5  HOURS 

FERRY 

9 

3.  0  HOURS 

LOITER 

10 

1.  0  HOURS 

INTERCEPT’ 

Source:  Oral  Communication-,  Major  T.  D.  Hill 

Edwards  AFB  Flight  Test  Center  (FTTED). 

longer  obvious  whether  a  particular  LRU  has  failed  or  malfunctioned. 
Hence,  N(F)  must  be  estimated  and  from  Section  5.  3  E^(N(R|N(F)) 
becomes  the  estimated  number  of  replacements  per  mission  type. 

It  should  be  recognized  that  the  determination  of  N(F)  for  a  parti¬ 
cular  LRU  for  a  given  mission  type  is  a  complex  data  processing  problem. 
For  details,  the  interested  reader  is  referred  to  Appendix  IV.  From 
Section  5.  3  and  the  estimates  of  N(F)  generated  according  to  Appendix  IV 
the  results  for  each  LRU  per  mission  type  summarized  in  Table  5.4.2 
were  obtained.  Finally,  if  each  element  in  Table  5.  4.  2  is  multiplied  by 
100  divided  by  the  respective  mission  duration  the  estimated  replacement 
for  each  LRU  per  100  flying  hours  per  mission  type  is  obtained  (see 
Table  5.4.3). 


6 


5.4.2.  Expected  Number  of  Critical  jLRU  Replacements  per  Missio 


5.  5  THE  EVALUATION  OF  CURRENT  REPLACEMENT  REQUIREMENTS 

From  the  results  of  Section  5.  4,.  it  is  not  obvious  what  the  procure¬ 
ment  policy  should  be  for  the  Critical  LRU's  under  consideration.  The 
difficulty  is  due  to  the  fact  that  in  an  operational  environment  the  mission 
mixture  is  a  random  variable.  If  the  mission  mixture  is  known  or  can  be 
estimated  then  the  procurement  policy  for  a  particular  LRU  should  be 
based  on 


10 

k  =  ]Cpj  Kj  *  (5-5ii) 

3=1 


where  the  K.'s  are  the  estimated  replacements  per  mission  (Table  5.4.2) 

..  3 

or  the  estimated  replacements  per  100  flying  hours  for  a  given  mission* 

type  (Table  5.4.3)  and  the  p.'s  are  luchthat 

3 


10 

^2  Pj  =  1  .  (5.  5.2) 

3=1 


In  this  section,  the  current  replacement  requirements  are  evaluated  when 
a  random  mission  mixture  is  assumed. 

Under  the  random  mission  mixture  assumption,  all  values  between  0 

and  1  are  possible  values  of  each  p.  in  (51.  5.  1).  Thus,  no  matter  what 

3 

mission  mixture  is  selected  the  corresponding  set  of  p.'s  gives  rise  to  a 

3 

particular  value  of  K  in  (5.  5.  1).  Here  the  distribution  of  K  is  generated 

for  500  random  mission  mixtures.  The  50,  85,  90  and  95  percent  points 

of  the  probability  distribution  of  K  for  each  LRU  are  given  in  Table  t5.  5.  1 

as  well  as  the  current  AFLC  K-value  from  Table  5.  1.  1  Section  5.  1.  Since 

the  current  AFLC  K-value  from  Table  5.  1.  1  is  a  particular  point  on  the 

distribution  of  K,  it  follows  that  the  respective  percentile  points  in 

Table  5.5.1  are  indicators  of  under  or  over  procurement  for  each  Critical 

th 

LRTJ.  By  definition  the  p  percentile  of  a  probability  distribution  is  that 
value  below  which  p  percent  of  the  distribution  of  values  will  fall.  For 
example,  the  95m  percentile  of  the  distribution  of  K  for  Critical  LRU  - 
Transmitter/Receiver,  WUC  73CAO,  is  2.  729.  This  implies  that,  if  the 
above  LRU  is  procured  on  the  basis  of  2.  729  replacements  per  100  flying 
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Comparison  of  K  Estimates  for  Eleven  Critical 
LRU's  for  Random  Mission  Mixture 
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Source:  258  Data  System  and  the  Mission  Debriefing  Form  0-294  for  the  F-lil,  Edward*  AFB,  California 

3*! 

Pr(K  <  k)  =  Probability  that  K  is  less  than  or  equal  to  the  value  k  is  p.  For  example,  the 
probability  that  K  5  1.299  for  critical  LRU  5  is  equal  to  0.  85,  etc. 


hours  for  a  random  mission  mixture,  then  there  is  a  95  percent  chance  of 
satisfying  the  spares  requirement  for  the  above  LRU-  For  additional 
comments,  see  Appendix  V  and  Section  5. 6  below. 

5.  6  EVALUATION  OF  THE  ANALYSIS 

It  is  important  to  recognize  that  as  the  F-i  11  Category  II  Testing 
C-ntinues  the  data  base  upon  which  the  above  analyses  are  based  will 
increase,  thereby  providing  additional  reliability  and  maintainability 
histories  for  the  above  UtU’s  of  interest.  Since  the  statistical  techniques 
used  here  are  based  on  averages,  it  is  well  known  that  as  the  sample  size 
increases  these  techniques  yield  results  which  converge  in  probability  to 
’ie  true  state  of  nature  provided  the  inputs  are  accurate.  Moreover,  it 
is  also  known  that  these  techniques  are  very  robust.  Hence,  it  can  be 
concluded  that  the  above  results  are  reasonably  accurate.  This  con¬ 
clusion  is  based  on  the  fact  that  the  inconsistencies  found  in  the  data 
elements  of  the  258/Mission  Debriefing.Data  System  are  relatively  minor 
as  far  as  traceable  errors  are  concerned.  But  it  should  be  recognized 
that  no  attempt  was  made  here  to  validate  the  total  data  system  or  the 
contents  of  the  data  base. 
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6.  0  EXPECTED  FOLLOW- ON  ACTIVITIES 

While  the  products  of  Section  5.-1  through  5,5were  developed  from 
the  current  data  base,  the  258  and  debriefing  data  were  not  completely- 
debugged  to  the  point  where  efficient  utilization  of  the  system  could  be 
accomplished.  Hence  EAFB  currently  has  urgent  need  for  status  report¬ 
ing  of  basic  data  as  well  as  the  results  of  more  sophisticated  analytical 
products. 

\ 

6.  1  DEVELOPMENT  OF  CURRENT  MONTHLY  PRODUCTS 

The  anticipated  monthly  products  for  EAFB/FTTE  are  expected  to 
include  (but  not  limited  to)  some  of  the  following  information: 

(1)  Oh  a  monthly  and  a  cumulative  basis: 

AFSC  -  WUC  -  HOURS/FLYING  HOUR 

AFSC  -  HOURS/ FLYING  HOUR 

WUC  -  HOURS/ FLYING  HOUR 

(2)  Total  maintenance  man-hours  per  flying  hour: 

(a)  Total  F-l  1 1  system 

(b)  For  each  subsystem 

(c)  For  Critical  LRU 

(d)  For  important  work  centers 

(3)  Aircraft  turn-around  time 

(a)  Man-hours 

(b)  Elapsed  hours 

(c)  Active  hours 

(4>  Aircraft  Status  Report 

The  objective  for  this  type  of  reporting  will  be  to  demonstrate  the  capa¬ 
bility  of  the  operational  reporting  system  to  provide  timely,  automated 
data  products  to  management.  Consequently,  the  spectrum  of  the  type  of 
products  produced  will  not  be  limited  to  those  indicated  above,  but  will 
include  the  results  of  analysis  to  any  degree  of  sophistication  required  to 
provide  products  which  can  be  used  simply  and  effectively  by  management 
to  enhance  their  operational  performance. 
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6.  2  ANALYTICAL  MODELLING 

As  indicated  in  Section  6.  i,  the  purpose  of  all  analytical  modelling 
in  the  follow-on  activities  willbe  to  provide  products  which  can  be  used 
simply  and  effectively  by  management  to  enhance  their  operational  per¬ 
formance.  When  viewed  in  this  light  the  products  of  Section  5.  i  through 
5.  5  enable  more  effective  decisions  in  the  areas  of  maintenance  and 
replacements.  The  objective  of  follow-on  modelling  willbe  to  continue 
this  type  of  analysis  in  areas  of  benefit  to  SAMSO/AFFTC. 

Analytical  techniques  will  be  provided  for  estimating  any  elements 
which  are  indicated  as  necessary  to  the  effective  support  of  the  system. 
Problems  which  AFLC  have  in  providing  adequate  support  will  be. 
approached  and  recommendations  made,  subject  to  eoncurrance  of 
SAMSO  and  AFFTC. 
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7.0  CONCLUSION 


•  From  this  study  the  following  observations  are  made: 

;{1).  The  storage  and  retrieval  of  a  large  volume  of 
operating  and  maintenance  data  on  a  timely  basis 
appears  feasible. 

This  program  has  demonstrated  that  accuracy  of  reporting  opera¬ 
tional  requirements  is  easier  for  a  larger  volume  of  data  and.  for  more 
diverse  requirements  when  the  operating  data  is  available -for  automated 
processing  using  analytical  models  developed  for  this  purpose. 

(2)  Category  II  operating  data  can  be  used  to  provide 
relatively  accurate  estimates  of  system  operating 
parameters  and/or  requirements. 

The  identification  of  the  probability  distribution  of  maintenance 
events  for  any  given  level  of  hardware  for  all  activity  on  the  total  system 
which  relates  to  that  level  of  the  system,  provides  an  analytical  tool'f dr- 
more  accurate  forecasting  of  operational  performance  in  the  actual  deploy 
ment  environment.  In  addition,  the  development  of  risk  levels  for  replace 
ments  per  hundred  hours  of  flying  time  enables  strong  justification  for 
LRU  procurement  levels. 

(3)  The  usefulness  of  the  258/debriefing  data  file  to 
the  improvement  of  some  estimates  of  reliability/ 
maintainability  parameters  has  been  demonstrated. 

The  ability  to  define  an  accurate  time-between-failure  and  time- 
to -maintain  has  been  adequately  demonstrated.  In  addition,  automatic 
plotting  of  results  has  been  shown  a  valuable  adjunct  to  the  clarification 
of  results. 

(4)  The  formatted  file  system  will  provide  a  useful 
means  for  access  to  system  operating  data  when 
properly  installed. 

In  addition  to  rapid  retrieval  of  stored  data,  FFS  provides  an 
efficient  means  to  relate  events  simultaneously  in  several  different 
dimensions.  This  provides  for  example,  the  correlation  among  part 
numbers,  work  unit  codes,  and  serial  numbers. 
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IBM  FORMATTED  FILE  SYSTEM  (FFS) 

ADAPTATION  REQUIREMENTS 

The  IBM  Formatted  File  System  was  written  for  the  IBM  7094 
Model  II  Computer  in  Macro  Assembly  Program  (MAP)  Language  and  as 
such  its  adaptation  is  restricted  to  the  IBM  .7094  or  to  comparable  com¬ 
puting  equipment  with  anTBM  7094  emulation  capability.  The  current 
hardware  requirements  for  FFS  is  ah  IBM  7094  Computer  with 

(1)  32K  Core,  and 

(2) '  17  tape  drives  or  their  equivalent  with  a  combination 

of  a  1 30 1<  disk  file  and  tapes. 

However,  due  to  modifications  to  the  system  it  has  been  adapted 
to  the  IBM  704477094  DCS  Computer  as  well  as  the  IBM  7090  Computer. 
Here  it  should  be  recognized  that  the  above  core,  and  Input/Output  require 
ments  must  be  satisfied.  Likewise  FFS  has  also  been  adapted  to  the 
IBM  360  by  .means'  of  the  IBM  360/7094  emulator. 

This  study  ha's  shown  that  FFS  is  a  very  useful  tool  as  far  as 
storage,  retrievaliand  data  base  management  from  which  reliability  and 
maintainability  analysis  can  be  made..  Thus  it  seems  that  a  useful  next 
step  in  the  development  of  FFS  is  to  rewrite  the  entire  system  ii.  a  high, 
level  language  . such  as  FORTRAN  IV  or  COBOL  so  that  it  may  be  adapted' 
to  a  variety  of  computering  hardware  without  major  modifications. 
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PART  I 

THE  DISTRIBUTION  OF  MAINTENANCE- EVENTS 
FOR  EACH  CRITICAL  LRU 


0.0  SUMMARY 

In  Section  5.  2  the  results  of  fitting  maintenance  data  to  three  well 
known  probability:  distributions  were  summarized.  Here  additional  details 
are  given  in  order  to  make  this  report  self  contained.  Part  I  of  this 
appendix  deals  with  probability  and  statistical  questions  concerning  fitting 
sample  data  to  theoretical  distribution  functions  and  gives  the  detailed 
results  of  problem  (1)  mentioned  in  Section  5.  0.  Part  II  of  this  appendix 
gives  the  algorithm  for  obtaining  the  sample  data  and  the  description  and 
flow  chart  of  the  computer  program  used. 

1.0  INTRODUCTION 

In  SAMSO  Report  No.  67-12,  it  was  shown  that  man-hours -to-repair 
the  actual  hardware  as  well  as  time  to  failure  or  time  between  failure  for 
subsystems  of  the  F-l'll  Category  II  Test  Data  can  be  fitted  to  certain 
standard  probability  distributions  automatically.  Here  the  distribution  of 
the  total  time  associated  with  maintenance  events  for  certain  items  of 
interest  from  the  F-lll  Category  II  Test  Data  is  considered.  In  order  to 
fix  ideas  the  following  definition  is  given. 

Definition  1 .  0:  The  administrative  and  technical  activities  associated 

with  the  restoration  of  a  device,  etc. ,  to  its  operating 
state;is  said  to  be  a  maintenance  event. 

Obviously,  a  maintenance  event  may  consist  of  a  series  of  activities 
such  as  repair,  test,  or  preventive  maintenance,  etc.  With  reference  to 
the  F-lll,  the  difference  between  line  and  shop  maintenance  are  distin- 
quished.  In  general,  line  maintenance  is  carried  out  on  devices,  etc. , 
on  the  aircraft  while  shop  maintenance  is  carried  out  on  such  devices, 
etc. ,  which  have  been  removed  from  the  aircraft.  Thus,  from  line  and 
shop  maintenance  events  the  sample  distribution  function  of  elapsed, 
active,  and  man  hours  respectively,  can  be  derived  which  will  allow 
inference  to  be  made  concerning  the  effectiveness  of  a  given  maintenance 
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policy.  Here,  however,  the  discussion  is  limited  to  the  distribution  of 
time  associated -with  line  maintenance  events. 

With  reference  to  Definition  i.  O.'let  T  be  the  time  required  to 
restore  a  particular  device,  etc.  ,  to  its  operating  estate.  When  T.  includes 
troubleshooting  time,  delay  time  due  to  shortages  of  parts,  transporta¬ 
tion  or  other  nonrelated:  factors,  as  well  as,  the  actual1  time  to  restore 
the  device,  etc. ,  to  its  operating  state,  then  T  is  the  elapsed  time 
associated  with'the  maintenance  event  -under  consideration.  On  .the  other 
hand,  when  T  includes  only  the  actual  tirne  to  restore  the  device,  etc. , 
to  its  operating  state,  then  T  is  the  active  time  associated  with  the 
maintenance  event  under  consideration.  Here  T  will  always  be  measured 
in  hours.  Hence,  without  loss  of  generality,  T  is  the  elapsed  hours  or 
the  active  hours  for  a  particular  maintenance  event.  Finally,  if  T  is  the 
time  required  for  maintenance  personnel  to  restore  the  device,  etc. ,  to 
its  operating  state  then  obviously  T  is  the  man-hours  for  the  particular 
maintenance  event. 

Observe  that  when  a  device,  etc. ,  malfunctions  or  fails  which  gives 
rise  to  a  maintenance  event  the  respective  elapsed,  active  and  man  hours 
for  the  event  cannot  be  predicted  until  the,  maintenance  activity  on  the 
device,  etc.  ,  under  consideration  has  been  completed,.  Thus  from  a 
statistical-  point  of  view,  T  is  a  random  variable.  By  definition  a  random 
variable  is  a  rule  (function)  which  assigns  to  each. maintenance  event  a 
corresponding  number  t  (time).  To  fix  ideas,  consider  a  population  of 
identical  devices,  etc. ,  which  have  failed  or  malfunctioned  and  let  f(t)  dt 
represent  the  proportions  of  the  population  of  devices,  etc. ,  which  can  be 
restored  to  their  operating  state  in  time  dt.  Then  by  definition 

F(t)  =  Pr  [*T<tj  =  /  f(x)  dx  (l,  1) 

'--Jo 

is  the  distribution  function  of  the  random  variable  T.  From  a  statistical 
point  of  view  any  function  F  with  the  following  properties  is  said  to  be  a 
distribution  function 


(i)  F  (-«)  =  0, 

(ii)  F(t)  is  non-decreasing  for-aj<t<co, 

(iii)  F(co)  =  1. 


In  the  continuous  case  a  random  variable  T  may  be  defined  in  terms  of  its 
density  function.  Hence,  any  function  f  with  the  properties 


(i)  f(t)  20,  -®<X<eo 

(ii)  Jf(t)dt=l 
-00 


can  serve  as  a  density  function  of  the  continuous  random  variable  T  and 
(1.  i)  gives  the  distribution  function  of  T  since  t>0. 

If  T  denotes  elapsed  hours  for  the  collection  of  maintenance  events 
generated  by  the  above  population<of  devices,  etc.,  then  F(t)  is  the 
distribution  function  for  elapsed. hours  for  that  population  of  devices,  etc. 
Here  F(t)  may  be  interpreted  as  being  the  chance  of  restoring  any  device, 
etc. ,  from  the  population  to  its  operating  state  in  t  elapsed  hours,  etc. 

Unfortunately,  the  total  population  of  devices,  etc.,  of  interest, 

cannot  be  observed,  instead,  only  random  observations  on  a  particular 

device,  etc. ,  can  be  made  when  it  fails- or  malfunctions.  This  is 

equivalent  to  random  sampling  from  the  population-  of  such  devices,  etc. , 

which  implies  that  a  value  of  T  is  selected  at  random  from  F(t),  since 

the  probability  distribution  of  T  for  the  particular  device,  etc.,  observed 

has  the  same  probability  distribution  as  the  population.  Thus,  if  the 

maintenance  events  are  observed,  for  a  particular  device,  etc. ,  over  a 

period  of  time,  a  sample  of  values  of  T  will  be  observed  namely,  t^,  t^, 

ty  ,  t^.  Suppose  the  tJs  are  ordered.  In  general,  let  t^j,  t^. . . 

t,  .  denote  the  ordered  t. 1  s,  then  by  definition 
(n)  J  7 


10:  Ift<t^ 

k/n:  If t^£t<t^k+ ^;k  =  i,  2,  ...,  n-i  (1.2' 

1:  If  t  >t,  . 

(n) 


is  the  sample  distribution  function.  In  (1.  2)  k  denotes  the  number  of  t^j's 
within  the  range  (t^,  t^).  Here  Sn(t )  is  the  observed  frequency  in  n 
maintenance  events,  for  which  T  <  t,  whose  true  probability  is  F(t),  the 
distribution  function  of  the  random  variable  T.  It  is  also  apparent  that 
Sn(t)  is  a  random  variable  since  it  is  based  on  a  sample  of  the  times 
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associated  with  maintenance  events.  The  importance  of  S^_(t)  is  that  for 
large  samples  (as  the  sample  size  n  becomes  infinite),  S^(t)  converges  in 
probability  to  F(t)  for  any  fixed  t.  Due  to  this  fact,  it  is  meaningful  to 
seek  the  theoretical  distributipn  function  F(t)  that  S^(t)  approximates  when 
the  true  probability  distribution  of  T  is.  not  known.  In  this  report  only  the 
following  probability  distributions  are  considered. 

Definition  1,  1  ( Lo g-normal) :  If  the  random  variable  T  is  such  that 

T*  =  loge  (T)  has  the  density 


f(t‘jji,  <r)  =  — -  exp 

(T  vTZtT 


(1.3) 


-°q<  t‘<  co, where  p.  and  c r  denote  the 
mean  and  variance  of  T',  then  T  is  said 
to  be  log-normal  with  mean 


m  ~  B(T)  =  exp  (ji  +  <r  /2)  , 


(1.4) 


and  variance 


VAR(T)  =  exp  +  <r^)j  -exp  j  2  p.  +  cr^ 


(1.5) 


Definition  1.2 


nential):  A  random  variable  T  is  said  to  be  distri- 


In  SAMSO  Report  No.  67-12,  it  was  shown  that  a  particular  distri¬ 
bution  function  F(t)  can  be  compared  with  S^(t)  by  means  of  the 
Kolmogorov-Smirnov  statistic.  Generally,  suppose  F(t)  is  a  particular 
distribution  function  we  wish  to  compare  with  Sn(t).  Since  F(t)  is  known; 
it  would  be  possible  to  calculate  the  value  of  js^ft)  -  F(t)J  for  any  desired 
value  of  t.  Furthermore,  it  is  reasonably  clear  that  it  would  be  possible 
to  calculate  the  value  of  the  quantity 

Dn  =  Sup|Sn(t)-F(t)|  (1.8) 

which  is  the  maximum  vertical  distance  between  the  graphs  of  F(t)  and 
Sn(t)  over  the  range  of  possible  t  values  (see  Figure  5.  2.  1  of  Section  5.  2). 
Observe  that  is  a  random  variable  with  a  given  distribution  function. 
According  to  Fisz  [¥j .  the  random  variable  D  </n"  is  distributed  as 
Q  (Pn>/n)  which  is  approximately 


n 


L  (-f)fc  exp(-2kZ\Z)  for  X>0 
Q(X}  =  Jk=  -oo 


0  for  X  £  0 


(1.9) 


for  large  n,  where 


(1.10) 


Since  Q(\)  does  not  depend  on  F(t)  we  can  use  Dn  to  test  hypotheses 
and  construct  confidence  limits  concerning  the  particular  distribution 
function  Sn(t)  approximates. 

As  mentioned  above,  the  random  variable  D  is  known  as  the 

n 

Kolmogorov-Smirnov  statistic  and  the  procedure  of  comparing  Sn(t)  with 
F(t}  by  means  of  is  known  as  the  Kolmogorov-Smirnov  goodness  of 
fit  test.  The  procedure  is  the  following:  Suppose  we  wish  to  test  the 
hypothesis 


H-5 


I 


H0:  Sn(t)*F(t) 

using  the  statistic  D^.  If  Hq  is  true  we  would  expect  Dn  to  be  small  and 
if  Hq  is  false  we  would  expect  to  be  large.  Since  (1.  10}  gives  the 
probability  that  the  statistic  is  less  than  xA/n,  it  follows  that 

Pr(Dn>XA/i)  =  1  -  Q(X).  (1.  11) 

Hence  if  Dn  is  large  the  right  hand  side  of  (1.  11)  will  be  small.  In 
statistical  terms  small  values  of  1  -  Q(X)  create  doubt  as  to  whether  the 
theoretical  distribution  of  the  random  variable  T  has  the  form  F(t). 

Thus  the  above  procedure  can  be  used  for  testing  the  hypothesis 
HQ:Sn(t)  =F(t)  against  Hj:Sn(t)  %  F(t)  which  rejects  HQ  when  is  too 
large.  This  is  accomplished  by  choosing  a  level  of  significance 

o  =  0.  01,  0.05,  or  0.  025,  etc.,  and  determining  a  for  which  j 

i 

i  -  Q(Dn  afn)*a.  (1.12)  j 

j 

Then  Dn  is  calculated  using  (1.  8).  If  Dn>  a  reject  HQ. 


i 
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APPENDIX  H 
PART  I 


2.0  THE  PROCEDURE  FOR  FITTING  MAINTENANCE  DATA  FOR 
CRITICAL  LRU'S  ON  THE  F-lll 

For  each  Critical  LRU  the  following  hypotheses  are  considered: 

1)  Log-normal  whose  logarithm  is  normal  (0,  1) 

t*  2 

Ho,  o"  sn(t-)-F(f|o,  1  frz  )dz 

-00  ' 

where  t*  =  loge(t), 

2 

2)  Log-normal  whose  logarithm  is  normal  (jjl,  <r  ) 

t’ 

Ho,  r  sn(t')-f(t’|,x,T2)  =  ^  «p  j-K^)  |«R 

3)  Exponential  with  parameter  X 

H0)  2:  Sn(t)  =F(t|\)  =  1  -  exp(-Xt), 


and  finally 

4)  Weibull  with  parameters  /3  and  X* 

t 

Hn  Sn(t)  =F(t|/3,  X*)  =  /3X*  /  z0'1  exp(-X*z^)dz. 

u,  ^  n  0 


Observe  that  the  parameters  p,  cr,  X,  )S  and  X*  are  unknown  for  the  above 
LRU's  of  the  F-lll.  Hence,  they  must  be  estimated  from  the  data.  It 
is  well  known  that 


n 


V 


s 


2 

t 


n 


1 


n-1 


E 


(2.1) 
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are  unbiased  estimators  of  p.  andcr  for  a  normal  distribution.  Similarly, 


^  =  {n-l)/Z  t. 
j=l  3 


(2.2) 


is  an  unbiased  estimator  of  X  for  an  exponential  distribution.  Unfortu¬ 
nately,  the  parameters  P  and  X*  of  the  Weibull  distribution  cannot  be 
determined  in  a  straight  forward,  manner.  Here  the  method  of  moments 
is  used  to  estimate  P  and  X*.  It  can  be  shown  that  the  mean  and  variance 
of  the  Weibull  distribution  are  given  by 

E(T)  =r(i+|)x*  p 

VAR(T)  =|r  (l  +  |)  -  (r  (l  +  |)j  2J  X*  **,  (2.  3) 

where  F{  .  )  is  the  gamma  function.  Equating  these  expressions  to  the 
mean  and  variance  of  the  sample  data  it  follows  that 

1  n 


(‘  +  f)  (r(‘  +  jj) )2}^  ?  =  jrr  <‘j  - 


v-,2  2 

t )  =  s  . 


(2.4) 


Solving  the  first  equation  in  (2.4)  for 

L 

_ L_ 

4^) 


(2.5) 


and  substituting  in  the  second  and  solving  for  the  ratio  of  gamma 
functions,  it  follows  that 


r 

(*♦!: 

i 

r( 

W) 

2 

(2.6) 


S 


Since  P  is  the  only  unknown  parameter  in  (2.  6)  it  can  be  determined  so 

A 

that  equality  holds,  then  X.*  can  be  determined  by' (2.  5).  The  values  p 
and  X*  determined  by  (2.  6)  and  (2.  5)  are  the  required  estimates  of  P  and 
X*  for  the  Weibull  distribution. 

In  order  to  carry  cut  the  ;goodness  of  fit  test  for  the  above  hypoth¬ 
eses,  the  parameters  in  the  respective  distribution  functions  are 
replaced  by  their  estimates  above  and  use  (1.  8).  A  computer  program 
for  testing  the  above  goodness  of  fit  hypotheses  is  described  in  DuBois  [2]. 
Here  that  program  is  used  to  carry  out  the  analysis  automatically  on  the 
computer. 
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APPENDIX  II 
PART  I 


3.0  THE  MOST  LIKELY  DISTRIBUTION  OF  MAINTENANCE 
EVENTS  FOR  CRITICAL  LRU'S  ON  THE  F-lll 

It  should  be  recognized  that  it  is  difficult  to  distinguish  among 
various  non- symmetrical  probability  distributions  oh  the  basis  of  actual 
observations,  since  there  is  only  significant  difference  in  the  tails  of 
such  distributions.  But  in  many  applications  actual  observations  are 
sparsed  from  the  tails  of  such  distributions  due  to  limited  sample  sizes. 
In  this  study,  there  exist  the  unusual  opportunity -of  having  an  increasing 
data  base  due  to  the  continuation  of  the  Category  II  testing  of  the  F-lil. 
Thus,  as  the  data  base  increases  the  sample  sizes  for  maintenance 
events  for  the  Critical  LRU's  studied  here  also  increases  (and,  hence, 
Sn(t)  for  these  LRU's  converge  in  .probability  to  their  respective  F(t). 
Since  the  procedure  for  fitting  S^(t)  to  F(t)  is  completely  automated,  the 
fitting  procedure  can  be  carried  out  each  time  the  data,  base  is  updated 
and  the  change  in  shape  of  S  (t)  can  be  observed,  if  any.  Obviously, 
inference  can  be  made  concerning  the  effectiveness  of  a  given  mainte¬ 
nance  policy  under  evaluation  based  on  the  updated  Sn(t)  for  the  critical 
LRU's  under  consideration.  The  results  for  four  of  the  eleven  Critical 
LRU's  studied  in  this  report  dre  given.  Seven  of  the  Critical  LRU's 
considered  had  insufficient  data  and,  hence,  the  above  analysis  is  not 
applicable. 

The  results  are  summarized  in  Tables  1  through  10.  The  tables 
a\re  grouped  by  Critical  LRU  for  shop  and  line  maintenance  events.  For 
example,  Tables  1  and  2  give  the  results  for  shop  and  line  maintenance 
hours  respectively,  for  Critical  LRU-Transmitter/Receiver, 

WUC  73CAO.  The  plots  of  the  sample  distribution  functions  and  the 
respective  theoretical  distributions  for  maintenance  hours  follow  each 
table,  For  example,  the  distribution  plots  for  shop  maintenance  hours 
for  the  above  LRU  are  given  in  Figures  1  through  9  following  Table  1  and 
the  corresponding  plots  for  line  maintenance  hours  are  given  in  Figures 
10  through  18  following  Table  2.  The  remaining  tables  and  plots  are 
organized  in  a  similar  manner. 


The  symbolic  notations  used  in  the  tables  are  defined  as  follows: 

_  2 

(1)  L(N(t',  s^, )  )  denotes  the  hypothesis  that.T  is  distributed 
as  a  log-normal  distribution  whose:  logarithm  is  normally 
distributed  with  mean  t'  and  variance  s~t  where  t'  =  log  (t). 

(2)  E(£)  denotes  the  hypothesis  that  T  is  distributed  as  an 
exponential  distribution  with  parameter  h. 

(3)  W((3,  denotes  the  hypothesis  that  T.  is  distributed  as  a 
Weibull  distribution  with  parameters  P  and 

Each  hypothesis  is  tested  at  the  0.  5  level  of  significance.  However, 

1  -  Q(Dn<Jh)  in  the  tables  is  the  computed  percentage  point  of 
Pr(Dns  X/  Jn),  hence,  the  reader  may  wish  to  use  some  other  level 
of  significance. 


It  should  be  recognized  that  one  cannot  conclude  that  Hq  j  is  not 

true  if  1  -  QiD^Jh)  is  very  small.  Although  the;  probability  of  the -event 

D^X/Jh  is  very  small,  provided  Hq,  ^  is  true,  such  an  event  may  occur 

in  practice.  At  this  point  the  statistician  makes  a  decision;  he  chooses 

a  critical  probability  a  =  0.05,  or  0.  01,  etc.  (level  of  significance)  such 

that  if  under  Hq  .  the  probability  of  an  outcome  more  extreme  than  the 

observed  event  is  not  greater  than  a,  he  will  reject  H.  On  the  other 

u,  j 

hand,  if  the  probability  f  the  observed  event  or  worse  is  greater  than  a, 

unfortunately,  it  can  only  be  said  that  the  data  does  not  contradict  Hq 

However,  the  notion  of  accepting  Hn  .  is  well  defined  in  statistical 

v,  j 

theory,  but  this  requires  a  discussion  of  the  concepts  of.  the  power  of  a 
statistical  test  and  confidence  intervals.  Therefore,  the  analysis  is 
restricted  to  rejecting  Hn  .  when  a=  0.05. 

vJ,  j 


From  Table  1  observe  that  1  -  Q(D^>Jh)  for  Hq  q  and  Hq  is 
essentially  0  which  creates  serious  doubt  as  to  whether  shop  elapsed 
hours  for  Critical  LRU  Transmitter/Receiver,  WUC  73CAO,  are  dis¬ 
tributed  as  a  log-normal  distribution  whose  logarithm  is  normally  dis¬ 
tributed  with  mean  0  and  variance  i  or  distributed  as  an  exponential 
distribution  with  parameter  \  =  0.  0143.  For  n  =  18  and  a’=  0.  05,  it  is 
found  from  Fisz-  [3]  that  D^g  =  0.  3205.  However,  1  -  Q(D^^h)  may  be 
compared  with  a  directly.  Since  D^g(N(0,  1))  >  D^g  and  Dj,g  (0.0143)> 
D18  a’  Ho  o  anc*  H0  2  are  rejecte^’  K  log-elapsed  hours  are  assumed 
to  be  distributed  as  a  normal  distribution  with  mean  2.  11  and 
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variance  4.  28  then  Djg(K'(2,  11,  4.  28))  <  D^g  Thus  the  test  does  not 
lead  to  rejection  of  Hq  Similarly,  the  test  does  not  lead  to  rejection 
of  Hq  y  Finally,;  since  1  -  Q(DnJn)  for  the  Weibull  distribution  is  less 
than  1  -  Q(DnJn)  for  the. normal  distribution  N(2.  11,  4.  28),,  it  follows 
that  shop  elapsed  hours  for  Critical  LRU  -  Tra.nsmitter/Receiver,. 

WUC  73CAO,  are  more  likely  to  be  distributed  as  a  log-normal  distri¬ 
bution  whose  logarithm  is  normally  distributed  with  mean  f  =  2.  11  and 
2 

variance  s^,  =4.28.  The  corresponding  plots  are  given  in  Figures  4,  5 
and  6.  Finally,  the  remaining  results. are  interpreted  in  a  similar 
manner. 
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Table  1:  Decision,  to  reject  the  null  hypothes 

distribution  function  approximates  a 
distribution  function,  where  a*  =  0.6 
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Figure  i.  Test  for  Log  Normality:  Critical  LRU  -  Transmitter/Rcceiver,  Shop  Active  Hours  WUC  73CAO 
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Table  2:  Decision  to  reject  the  null  hypothesis  that  the  sample 
distribution  function  approximates  a'  given  theoretical 
distribution  function,  where  a  -  0.05. 
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Hours  WUC  73BDO 


est  for  Exponential  Data:  Critical  LRU  -  Modulator,  Receiver/ Transmitter,  Shop  Elapsed 
ours  WUC  73BDO 


11-39 


Figure  24.  Test  for  Weibull  Data:  Critical  LRU  -Modulator,  Receiver/ Transmitter,  Shop  Elapsed 
Hours  WUC  73BDO 
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Figure  37.  Test  for  Log  Normality:  Critical  LRU  -  Stabilization  Platform  Unit,  Shop  Active  Hours 
WUC  73AAO 


Figure  39.  Test  for  Weibull  Data:  Critical  L.RU  -  Stabilization  Platform  Unit,  Shop  Active  Hours 
WUC  73AAO 
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Figure  40.  Test  for  Log  Normality:  Critical  -LR.U  -  Stabilization  Platform  Unit,  Shop  Elapsed  Hours 
WUC  73AAO 


Figure  41.  Test  for  Exponential  Data:  Critical  LRU  -  Stabilization  Platform  Unit,  Shop  Elapsed  Hours 
WUC  73AAO 


Figure  43.  Test  for  Log  Normality:  Critical  LRU  -  Stabilization  Platform  Unit,  Shop  Man  Hours 
WUC  73AAO 


44.  Test  for  Exponential  Data:  Critical  LRU  -  Stabilization  Platform  Unit,  Shop  Man  Hours 
WUC  73AAO 
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Figure  45.  Test  for  Weibull  Data:  Critical  LRU  -  Stabilization  Platform  Unit,  Shop  Man  Hours 
WUC  73AAO 
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■ce:  258  Data  System  for  the  P-111,  Edwards  AFB,  California 

Table  1  for  definition  of  L(N(ji,  ff2)),  E(X)  and  W(8,X). 


Figure  48.  Test  for  Weibull  Data:  Critical  LRU  -  Stabilization  Platform  Unit,  Line  Active  Hours 
WUC  73AAO 


est  for  Exponential  Data:  Critical  LRU  -  Stabilization  Platform  Unit,  Line  Elapsed  Hours 
rUC  73  A  AO 


Figure  53.  Test  for  Exponential  Data:  Critical  LRU  -  Stabilization  Platform  Unit,  Line  Man  Hours 
WUC  73AAO 


Lire  55.  Test  for  Log  Normality:  Critical  LRU  -  Navigational  Computer  CP812/AJQ-20  Shop  Activo 
Hours  WUC  73ABO 


;xponential  Data:  Critical  LRU  -  Navigational  Computer  CP8i2/AJQ-20  Shop  Active 
C  73ABO 


Weibull  Data:  Critical  LRU  -  Navigational  Computer  CP8 12/ AJQ-20  Shop  Active 
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Figure  62.  Test  for  Weibull  Data:  Critical  LRU  -  Navigational  Computer  CP812/AJQ-20  Shop  Man  Hours 
WUC  73 ABO 


Decision  to  reject  the  null  hypothesis  that  the  sample 
distribution  function  approximates  a  given  theoretical 
distribution  function,  where  a  =0.05. 
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Figure  63.  Test,  for  Log  Normality:  Critical  LRU  -  Navigational  Computer  CP812/AJQ-20  Line  Active 
Hours  WUC  73 ABO 
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Figure  68.  Test  for  Weibull  Data:  Critical  .LRU  -  Navigational  Computer  CP8 12/ AJQ-20  Line  Elapsed 
Hours  WUC  73 ABO 


>r  Exponential  Data:  Critical  LRU  -  Navigational  Computer  CP812/AJQ-20  Lino  Man 


Table  9:  Decision  to  reject  the  null  hypothesis  that  the  sample 
distribution  function  approximates  a  given  theoretical 
distribution  function,  where  a  =  0.05. 
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Figure  74.  Test  for  Weibull  Data:  All  Critical  LRU1  s 
WUC  52BBR,  WUC  52ADA  and  WUC  73AB 
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Figure  75.  Test  for  Log  Normality:  All  Critical  LRU' s  Combined  -  Shop  Elapsed  Hour s,  LRU's 
WUC  52BBR,  WUC  52  AD  A  and  WUC  73  ABO  Not  Included 
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WUC  52BBR,  WUC  5 2 ADA  and  WUC  73ABO  not  included. 


st  for  Log  Normality:  All  Critical  LRU's  Combined  -  Lino  ActivcI-Iours 
JC  52BBR,  WUC  52ADA  and  WUC  73ABO  Not  Included 


52ADA 


for  Exponential  Data:  All  Critical  LRU' s  Combined  -  Line  Elapsed  Hours,  LRU's 
52BBR,  WUC  52  AD  A  and  WUC  7  3  ABO  Not  Included 


X 


11-107 


Figure  85.  Test  for  Weibull  Data:  All  Critical  LRU' s  Combined  Line  Elapsed  Hours,  LRU'sWUC  52BBR; 
WUC  52  AD  A  and  WUC  73  ABO  Not  Included 


st  for  Exponential  Data:  All  Critical  ERU's  Combined  -  Line  Man  Hours,  LRU’sWUC  52BBR» 
rc  52ADA  and  WUC  7SABO  Not  Included 


Test  for  Weibull  Data:  Ail  Critical  LRU1  s  Combined  -  Lino  Man  Horn* o*  LRU'flWUG  52BBR 
WUC  52ADA  and  WUC  73ABO  Not  Included 
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DATA  PROCESSING  REQUIREMENTS  FOR  CRITICAL 
LRU  MAINTENANCE  EVENTS  DATA 


0.0  SUMMARY 

The  data  processing  requirements  for  the  determination  of  the 
most  likely  probability  distribution  for  maintenance  events  for  each 
Critical  LRU  identified  in  Section  5.  1  can  be  divided  into  two  phases: 

(1)  Retrieval  and  formatting  of  Critical  LRU  maintenance 
events 

(2)  The  calculation  of  the  sample  and  theoretical  distributions 
from  these  data. 

The  results  and  the  analytical  considerations  for  (2)  are  given  in  Part  I 
of  this  appendix.  In  this  part  of  Appendix  II  the  data  processing 
considerations  are  given. 

i.  0  RETRIEVAL  AND  FORMATTING  OF  CRITICAL  LRU 
MAINTENANCE  EVENTS 

The  data  processing  requirements  for  maintenance  events  were 
accomplished  by  analyzing  all  Critical  LRU  failure  indications  retrieved 
from  the  258  data  base  in  order  to  determine  the  original  report  numbers 
(ORN)  which  identified  the  Critical  LRU  maintenance  events. 

The  following  routine  was  used  to  retrieve  and  format  the  Critical 
LRU  maintenance  data  needed  for  the  analysis  in  Part  I  of  this  appendix. 

(1)  Select  specific  original  report  numbers. 

(2)  Sort  retrieved  items  by  original  report  number. 

(3)  Output  the  following  two  records  for  each  Critical  LRU. 

(a)  HEADER  cols.  1-6  (blanks  through  col.  48) 

(b)  Critical  LRU  identifier  cols,  1-48  (variable) 

(4)  Output  the  following  record  for  each  report: 

ORIGINAL  REPORT  NUMBER  (OPN)  COLS. 

REPORT  DATE  (Year /Month/Day)  COLS. 

TOTAL  MAINTENANCE  HOURS  COLS. 

LOCATION  (Line  or  Shop)  COLS. 


1  -  6 
7  -  12 
35  -  39 
40  -  43 


H-lll 


(5)  Output  the  following  record  for  each  maintenance  entry 
entered  on  the  report 


ORIGINAL  REPORT  NUMBER  (ORN) 

COLS. 

1  -  6 

REPORT  DATE  (Year/Month/Day) 

COLS. 

7-12 

START  TIME 

COLS. 

13  -  16 

STOP  TIME 

COLS. 

17  -  20 

DELAY  CODE 

COLS. 

21  -  23 

START  TIME 

COLS. 

24  -  27 

STOP  TIME 

COLS. 

28  -  31 

DELAY  CODE 

COLS. 

32  -  34 

LOCATION  (Line  or  Shop) 

COLS. 

40  -  43 

(6 )  Output  the  following  as  the  final  record 

ENDFIL  COLS.  1  -  6 
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2.  0  THE  CALCULATIONS  OF  TIME  ASSOCIATED  WITH  CRITICAL 
LRU  MAINTENANCE  EVENTS 

The  computer  program  used  to  summarize  the  maintenance  events 
data  retrieved  from  the  F-l  1  1  Category  II  data  base  by  FFS  is  described 
below. 

ACTIVE  HOURS  PROGRAM 

This  program  takes  data  in  the  form  of  punched  cards  from  the 
retrieval  procedure  mentioned  in  Section  1.  0  above.  In  general,  this 
program  computes  active  hours,  elapsed  hours,  and  man  hours  (sub¬ 
divided  by  shop  and  line)  for  each  original  report  number.  The  procedure 
is  as  follows:  original  report  numbers  are  grouped  into  several  Critical 
LRU  categories  and  sorted  within  a  categrory  by  report  number.  For 
identification  purposes  a  title  card  is  generated  for  each  original  report 
number.  Generally,  the  main  program  reads  a  Critical  LRU  title  card, 
then  summarizes  all  data  from  each  original  report  number  sequence  for 
that  LRU.  The  active  hour  data  is  stored  in  an  array  subdivided 
according  to  line  and.  shop  and  man  hours  data  are  treated  in  a  similar 
manner.  When  all  data  for  a  given  report  number  is  summarized.  Sub¬ 
routine  ACTCAL  is  called  to  do  the  actual  active  hours  computation,  then 
upon  returning  to  the  main  program  a  single  line  of  output  is  printed  and 
punched  for  that  report  number.  In  addition  to  the  ACTCAL  routine, 

SORT  and  TIME  7  are  also  used.  SORT  is  used  by  ACTCAL  to  sort  the 
start/ stop  times  by  start  time.  TIME  7  is  used  by  the  main  program  to 
convert  all  time  to  hours  since  1  January  1966. 

DESCRIPTION  OF  THE  INPUT  DATA 

The  input  to  this  program  is  the  following  punched  card  deck. 

(1)  HEADER  CARD  Containing  the  work  HEADER 

punched  in  columns  i  -  6.  A 
HEADER.  CARD  must  be  immediately 
followed  by  a  TITLE  CARD 
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(2)  TITLE  CARD  Containing  a  Critical  LRU  title 

punched  in  columns  1-48. 

(3)  DATA  CARD  Containing  an  original  report 

number  (ORN;  in  columns  1-16. 

A  date  of  the  form  (year/month/aay) 
in  columns  7  -  12, 

A  start  time  in  13  -  16, 

A  stop  time  in  1?  -  20, 

A  three  character  alpha  field  in 
21  -  23, 

A  start  time  in  24  -  27. 

A  stop  time  in  28  -  31, 

A  three  character  alpha  field  in 
columns  32  -  34, 

A  man-hours  value  in  columns 
35  -  39, 

The  work  LINE  or  SHOP  in 
co3.umns  40  -  43. 

Here  the  DATA  Cards  for  a  particular  Critical  LR.U  must  be  sorted  by 
original  report  number. 

(4)  TERMINATOR  CARD  Containing  the  word  E-NDFIL  in 

column  1-6.  This  must  be  the 
last  card  of  the  data  deck. 
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A  TYPiCAL  DATA  DECK  MIGHT  LOOK  AS  FOLLOWS: 


Figure  2.  1:  A  typical  data  deck  setup  for  the  Active  Hours  Program. 
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LIMITATIONS 


No  more  than  500  start/ stop  time  pairs  will  be  accepted  for  LINE 
or  SHOP.  Moveover,  any  data  card  that  does  not  contain  the  words  LINE 
or  SHOP  in  columns  40  -  43  will  be  ignored.  In  addition,  there  are  two 
sets  of  start/stop  times  on  each  data  card.  Each  time  pair  is  followed 
by  a  three  character  tag  field.  If  this  tag  field  contains  the  letter  T 
(left  justified)  then  the  associated  start/stop  time  is  ignored. 


DESCRIPTION  OF  KEY  VARIABLES 


IHDR 

INUMT 

LINECT 

XMANHR  (1),  XMANHR  (2) 

JK  (1),  JK  (2) 

T(I,  1,  1),  T(I,  2,  i) 

T(I,  1,  2),  T(I,  2,  2) 
ACTHR1,  ACTHR2 


Critical  LR.U  title 

Current  original  report  number 

Output  line  counter 

Accumulated  man-hours  for 
shop  and  line 

Total  number  of  active -hour 
start/stop  time  pairs  for  shop 
and  line 

Start/stop  time  pair  (shop) 

Start/stop  time  pair  (line) 

Total  active  hours  for  shop 
and  line 


ELKR1,  ELHR2 


Total  elapsed  hours  for  shop 
and  line 


Figure 


REAP 

INUM,  IYR,  !MON,  IPAY, 
1, 12),  IMWfl  1, 12), 

I2  =  I,2),!TAG{I1),I1=I,2), 
XMHR,  ILS 


I 


ADD  XMHR  TO 
XMANHR 


PUT 

START-STOP  TIME 
IN  ARRAY  T 


.  2:  Flow  Chart  of  che  Main  Routine  in  the  Active  Hours  Program 
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SUBROUTINE  ACTCAL 


The  start/stop  time  pairs  are  sorted  by  start  time  in  this  routine. 
Then  for  each  start  time  the  latest  stop  time  is  found  and  if  this  time 
does  not  overlap  the  next  time  interval,  this  time  period  is  added  to  the 
accumulated  sum.  If  the  next  interval  is  contained  in  this  time  period, 
the  next  interval  is  ignored.  Otherwise,  an  overlap  occurs  and  the  first 
interval  is  modified  to  reflect  this  overlap. 

DESCRIPTION  OF  KEY  VARIABLES 


T  (500,  2) 

Array  contains  start/stop  times 

IMAX 

Number  of  start/stop  pairs 

ACTHRS 

Total  active  hours 

ELHRS 

Total  elapsed  hours 
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DATA  PROCESSING  REQUIREMENTS  FOR  REPLACEMENTS 
AND  FAILURE  INDICATIONS 


0.0  SUMMARY 

The  derivation  of  the  mathematical  relationship  between  failure 
indications  and  replacements  can  be  partitioned  into  the  areas  of 
processing: 

(1)  Retrieval  of  failure  indications  from  the  258  data  base 
and  the  determination  of  whether  a  line  or  shop  replace¬ 
ment  occurred. 

(2)  The  calculation  of  the  regression  of  replacements  per 
unit  time  on  failure  indications  per  unit  time  for  each 
critical  LRU. 

In  this  appendix  the  data  processing  requirements  for  problem  (2)  of 
"ection  5.  0  are  given. 

i.  0  THE  DEFINITION  OF  FAILURE  INDICATION 
AND  REPLACEMENT 

The  following  definitions  form  the  basis  for  the  algorithm  used  in 
the  computer  programs  described  in  this  appendix.  A  failure  indication 
is  defined  as  a  maintenance  event  with  an  "Action  Taken"  Code  (ACTAK) 
of  P,  R,  S,  F,  G,  K,  L,  Y  or  Z  (Table  4.2.  i)  and  a  "How  Malfunction" 
Code  (HOW  MAL)  that  is  not  a  "No  Defect"  Code  (Table  4.3.2).  On  the 
other  hand,  a  line  level  replacement  occurs  when  a  piece  of  hardware  is 
removed  and  replaced  by  a  like  piece  of  hardware  with  a  different  part 
number  P/N  and  serial  number  S/N.  This  occurs  if  the  "ACTAK"  of  the 
failure  indication  is  of  the  R,  P  or  Q  type  and  the  maintenance  event 
directly  related  to  the  P  has  a  different  P/N  and  S/N.  Generally,  a  line 
level  replacement  does  not  occur  when  the  ACTAK  of  the  failure  indica¬ 
tion  is  S,  F,  G,  K,  L,  Y  or  Z,  or  if  the  P  and  the  associated  Q  ACTAK 
have  the  same  P/N  and  S/N. 

Similar  to  the  above  a  shop  level  replacement  occurs  when  a  piece 
of  hardware  is  removed  as  a  result  of  a  failure  indication,  i.  e. ,  if  the 
ACTAK  of  the  failure  indication  is  a  R  or  P  and  the  piece  of  hardware  is 
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condemned  at  the  shop  level  or  shipped  off  base  for  repair.  Obviously,  a 
shop  level  replacement  does  not  occur  if  the  piece  of  hardware  removed 
as  a  result  of  a  P  or  R  ACTAK  failure  indication  is  rendered  serviceable 
in  the  shop. 

2.0  THE  ALGORITHM 

The  algorithm  used  is  the  following: 

(I)  Retrieve  failure  indication  data 

(II)  Retrieve  data  necessary  to  determine  replacement  status 
of  each  failure  indication. 

(IH)  Determine  replacement  status  of  each  failure  indication. 
This  falls  into  the  following  categories: 

(1)  Line 

(a)  Replacement  occurred 

(b)  Replacement  did  not  occur 

(c)  Status  unknown 

(2)  Shop 

(a)  Replacement  occurred 

(b)  Replacement  did  not  occur 

(c)  Status  unknown 

(IV)  Generate  class  intervals  in  calendar  time  (time  of  occur- 
ance  for  each  failure  indication)  for  each  aircraft  and 
calculate  the  number  of  failure  indications  and  replace¬ 
ments  per  class  interval  and  output  the  results  in  a  format 
suitable  for  regression  analysis. 

The  only  portion  of  the  algorithm  which  posed  implementation 
problems  was  that  of  handling  failure  indications  where  the  replacement 
status  was  unknown  through  incomplete  or  incorrect  reporting.  These 
events  could  either  be  replacement  or  no  replacement  events.  If  these 
events  are  considered  to  be  replacement  events,  a  higher  level  of 
replacements  than  actually  occurred  are  observed,  i.e.,  "a  worse  case 
spares  requirements."  On  the  other  hand,  if  these  events  are  considered 
not  to  be  replacement  events,  a  lower  level  of  replacement  than  actually 
occurred  are  observed,  i.e.,  "a  least  case  spares  requirement."  The 


worse  and  least  case  assumptions  give  an  upper  and  lower  bound  for  the 
relationship  between  replacements  and  failure  indications  with  the  true 
re.  ltionship  lying  between  these  two  extremes.  The  distance  between 
these  bounds  serves  as  an  excellent  measure  of  the  quality  of  the  data  and 
the  accuracy  of  the  results  obtained  from  these  data.  The  manner  in 
which  this  was  handled  is  summarized  below. 

The  data  retrieval  and  reduction  task  described  earlier  was  broken 
into  three  sections  for  programming  efficiency.  In  the  first  section,  the 
failure  indications  and  events  necessary  to  determine  its  replacement 
status  were  retrieved  and  formatted  using  FFS.  The  exact  selection 
criteria  and  output  formats  are  below.  The  second  and  third  sections 
v/ere  programmed  separately  but  executed  on  the  computer  as  one  job. 

In  the  second  section,  the  replacement  status  of  a  failure  indication  is 
determined.  Since  there  are  two  cases  to  be  considered,  for  both  shop 
and  line,  four  versions  of  the  routine  which  determine  replacement  status 
were  developed.  The  four  routines  and  their  respective  functions  are 
the  following: 

(1)  MATCH  -  Carries  out  line  level  processing  assuming 
"no  replacement"  in  doubtful  cases 

(2)  MATCH2  -  Same  as  MATCH  for  shop  level  processing 

(3)  MATCH3  -  Carries  out  line  level  processing  assuming 
"replacement"  in  doubtful  cases. 

(4)  MATCH4  -  Same  as  MATCH3  for  shop  level  processing 

These  routines  accept  data  retrieved  and  formatted  by  FFS  and 
output  these  data  in  a  format  for  additional  processing. 

The  matched  data  from  the  above  routines  are  processed  by  a 
series  of  sorts  and  routines  to  produce  the  number  of  replacements  and 
failure  indications  for  a  given  time  class  interval.  These  data  are  sepa¬ 
rated  by  Critical  LRU  and  the  aircraft  in  which  it  was  installed, 

3.0  FSS  PROCESSING 

The  retrieval  and  formatting  of  the  data  was  accomplished  through 
FFS.  The  specifications  are  the  following: 

(I)  Select  line  actions  which  satisfy  either  of  the  following 
criteria: 
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(1)  Action  taken  code  equal  to  F,  G,  K,  L,  P,  R,  S,  V, 

Z.  And  how  malfunction  code  not  eaual  to  793,  797, 

798,  799,  800,  801,  802,  811,  812. 

(2)  Action  taken  code  equal  to  Q. 

(II)  From -the  line  items  that  satisfy  either  of  the  above  criteria 

select,  by  work  unit  code,  each  Critical  LRU  aha  perfoi'm 
the  following  selective  output  actions: 


(i)  If  the  action  taken  code  is  P,  S,  F,  G,  K,  L,  V  or  Z 
output  the  following  record: 


CRITICAL  LRU  Number 
AIRCRAFT  SERIAL  Number 
ORIGINAL  REPORT  Number 
FAILED  LRU  PART  Number 
FAILED  LRU  SERIAL  Number 
ACTION  TAKEN  CODE 
DISCOVERED  DATE  AND  TIME 
HOW  MALFUNCTIONED  CODE 
WORK  UNIT  CODE 
CONSTANT  ZERO 


COLS.  1-4 
COLS.  5-14 
COLS.  15-20 
COLS.  21-35 
COLS.  36-45 
COL.  46 
COLS.  47-56 
COLS.  67-69 
COLS.  70-77 
COL.  78 


(2)  If  the  action  taken  code  is  Q  output  the  following 
record: 


CRITICAL  LRU  Number 
AIRCRAFT  SERIAL  Number 
ORIGINAL  REPORT  Number 
INSTALLED  LRU  PART  Number 
INSTALLED  LRU  SERIAL  Number 
ACTION  TAKEN  CODE 
DISCOVERED  DATE  AND  TIME 
REPORT  DATE 

HOW  MALFUNCTIONED  CODE 
WORK  UNIT  CODE 
CONSTANT  ZERO 


COLS.  1-4 
COLS.  5-14 
COLS.  15-20 
COLS.  21-35 
COLS.  36-45 
COL.  46 
COLS.  47-56 
COLS.  57-62 
COLS.  67-69 
COLS.  70-77 
COL.  78 


III- 4 


(3)  If  the  action  taken  code  is  R  output,  the  following 


record: 

CRITICAL  LRU  Number 

COLS.  1-4 

AIRCRAFT  SERIAL  Number 

COLS.  5-14 

ORIGINAL  REPORT  Number 

COLS.  15-20 

FAILED  LRU  PART  Number 

COLS.  21-35 

FAILED  LRU  SERIAL  Number 

COLS.  36-45 

ACTION  TAKEN  CODE 

COL,  46 

DISCOVERED  DATE  AND  TIME 

COLS.  47-56 

REPORT  DATE 

COLS.  57-62 

HOW  MALFUNCTIONED  CODE 

COLS.  67-69 

WORK  UNIT  CODE 

COLS.  70-77 

CONSTANT  ZERO 

COL.  78 

(III)  Select  shop  actions  which  have  one  of  the  following  action 
taken  codes: 

A,  B,  F,  G,  H,  J,  K,  L,  N,  R,  S,  V,  X,  Z 

(IV)  From  the  line  items  that  satisfy  the  above  criteria  select, 
by  work  unit  cede,  each  critical  LRU  and  output  a  record 
in  the  format  of  (3)  under  II  above  with  a  constant  ONE 

in  COL.  78. 

(V)  Output  the  following  as  the  final  record: 

((((  COLS.  1-4 

((((((  COLS.  15-20 

The  manner  in  which  these  specifications  were  applied  varied 
according  to  which  Critical  LRU  was  being  considered  and  to  which 
routine  these  data  were  to  serve  as  input. 

4.  0  PROCESSING  THE  DATA  FROM  FFS 

The  general  processing  procedure  is  outlined  in  Figure  4.  1. 


If  files  between  steps  are  not  indicated  as  tapes,  they  are  on  inter¬ 
system  reserve  units  (disk).  The  input  to  MRGE  (Figure  4. 1)  has  the 


following  format: 

COL,. 


1-4 

4K- NUMBER 

5-14 

AIRCRAFT- NUMBER  (A/C) 

15-20 

ORIGINAL  REPORT  NUMBER 

21-35 

PART- NUMBER 

36-45 

SERIAL- NUMBER 

46 

ACTAK 

47-56 

FAIL  TIME 

57-66 

REPLACE  TIME 

67-69 

HOW  MAL 

70-77 

WORK  UNIT  CODE  (WUC) 

78 

LINE  OR  SHOP  CODE  (0  or  1)  - 
MATCH2  and  MATCH4  only 

79-84 

BLANKS 

The  last  record  on  each  tape  is  as  follows: 
COL.  1-4  «((((' 

5- 14  blanks 

15-20  '((((((' 

21-84  BLANKS 


The  input  to  MATCH  (Figure  4.  1)  is  the  same  as  the  input  to  MRGE. 
On  the  other  hand,  the  input  to  CLASS  is  the  following: 

(1)  Control  cards  (between  a  $DATA  card  and  a  $EOF  card, 

following  CLASS),  indicating  calendar  hour  class  intervals: 

COL.  1-6  Interval  in  hours, 

right  justified 

7-80  blank 


Last  control  card: 

COL.  1-6  '999999' 

7-80 


blanks 


(2)  File  from  any  MATCH  program,  sorted  on  4K, 
A/C,  FAIL-  TIME,  REPLACE- TIME: 


COL.  1-4 

4K-  NUMBER 

5-8 

A/C  (last  4  characters) 

9-18 

FAIL  TIME 

19-28 

REPLACE  TIME 

29-84 

BLANKS 

Dummy  EOF,  last  record  on  tape: 

COL.  1-4 

*((((' 

5-14 

BLANKS 

1 5-34 

ZEROS 

35-84 

BLANKS 

Similar  to  (2)  above  for  CLASS  the  input  to  SUMRY  must  be  sorted  on 
DATA- GROUP,  4K,  AIRCRAFT  (A/C'  FAIL- INTERVAL.  The  input 

format  is  the  following: 

COL.  1-2 

Indicates  to  which  DATA- GROUP 
data  belongs  (01,  02,  . . . ) 

3-6 

4K- NUMBER 

7-10 

A/C- NUMBER 

11-16 

FAIL  INTERVAL 

17-22 

FAIL  COUNT 

23-28 

REPLACE  INTERVAL 

29-34 

REPLACE  COUNT 

35-84 

BLANKS 

One  card  preceding  the  data  for  each  calendar  hour  interval  with  the 
following  format  is  required. 

COL.  1-2  Same  as  above  (increases  by 

one  for  each  of  these  cards) 

3-8  CALENDAR  HOUR  INTERVAL 

9-84  BLANKS 
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PR.OGRAM  DESCRIPTION 

MRGE  places  every  record  from  each  of  the  two  tapes  generated  by 
FFS  retrieval  on  to  a  single  file. 

SORT1  sorts  the  file  created  by  MRGE.  Scientific  collating  sequence 
is  used.  The  sort  for  data  into  MATCH  or  MATCH3  is:  ORIGINAL- 
REPORT- NUMBER,  PART-NUMBER,  and  ACTION- TAKEN  CODE.  The 
sort  for  data  into  MATCH2  or  MATCH4  is:  AIRCRAFT- NUMBER,  PART- 
NUMBER,  SERIAL- NUMBER,  LOCATION- CODE  (line  or  shop),  ACTION- 
TAKEN  CODE  and  ORIGINAL- REPORT. 

MATCH  attempts  to  match  line  F  and  Q  actions  (remove  and 
install)  to  determine  if  a  spares  requirement  is  generated.  Other  action 
codes  are  passed  on  to  CLASS  unaltered. 


DESCRIPTION  OF  KEY  VARIABLES 


IBSYS,  JSYS  Functional  4000- Number 

ISER1,  JSER2  Aircraft  Number  (A/C) 

ISER2,  JSER2 

IRPT,  JRPT  Original  Report  Number 

IPTNR1,  JPTNR1 

IPTNR2,  JPTNR2  Part  Number 
IPTNR3,  JPTNR3 


ISERL1,  JSERL1 
ISERL2,  JSERL2 


Serial  Number 


IACTC,  JACTC  Action  Taken  Code 


IFAILi,  FAIL1 
IFAIL2,  JFAIL2 


Fail  Time 


IRPLCi,  JRPLC1 
IRPLC2,  JRPLC2 


Replace  Time 


The  Flow  Chart  of  MATCH  is  given  in  Figure  4.  2. 


MATCH2  attempts  to  match  P  and  Q  line  actions,  P  or  R  line 
action  with  matching  shop  action.  A  restriction  that  matching  records 
occur  within  30  days  is  placed  on  the  above.  P  and  R  orphan  recordo 
are  outputted  as  well  as  all  other  line  actions.  A  lone  Q  line  item  and 
all  lone  shop  items  are  ignored. 
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REPLACE-TIME  1 

-O 

REPLACE  TIME  1 
»  REPLACE  TIME  J 

' 

WRITE 

RECORD 

I 


Figure  4.  2:  Flow  Chart  of  MATCH 
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DESCRIPTION  OF  KEY  VARIABLES 


The  key  variables  for  MATCH2  are  the  same  as  MATCH  with  the 
following  exceptions: 


IPNi,  JPN1 

IPN2,  JPN2  Part  Number 

IPN3,  JPN3 


ISN1,  JSN1 
ISN2,  JSN2 


Serial  Number 


IYRF,  JYRF 

IMONF,  JMONF 

IDAYF,  JDAYF  Fail  Time 

IHRF,  JHRF 

IMINF,  JMINF 


IYRR,  J-YRR 
IMONR,  JMONR 

IDAYR,  JDAYR  Replace  Time 

IHRR,  JHRR 
IMINR,  JMINR 

LCODE,  FLOCOD  Line  or  Shop  Location  Code 


The  Flow  Chart  of  MATCH2  is  given  in  Figured.  3. 


MATCH3  used  to  match  P  and  Q  actions.  When  MATCH  encoun¬ 
tered  doubtful  matches,  it  assumed  no  spares  requirement.  MATCH3,  on 
the  other  hand,  assumes  a  spares  requirement  is  generated  by  doubtful 
matches,  in  effect,  worse  case  spares  generation. 


DESCRIPTION  OF  KEY  VARIABLES 


The  key  variables  for  MATCH3  are  the  same  as  those  for  MATCH. 
The  Flow  Chart  of  MATCH3  is  given  in  Figure  4.4. 

MATCH4  associates  F,  Q  and  R  line  actions  with  shop  actions  that 
are  consequently  generated.  MATCH4  assumes  worse  case  conditions, 
i.e.,  a  requirement  for  spares  has  been  generated  in  all  doubtful  cases. 
Finally  no  time  restrictions  are  observed  on  associated  line  and  shop 
actions  in  MATCH4. 


DESCRIPTION  OF  KEY  VARIABLES 

The  key  variables  of  MATCH4  are  the  same  as  those  for  MATCH2. 
The  Flow  Chart  of  MATCH4  is  given  in  Figure  4,  5. 
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Figure  4.  4:  Flow  Chart  of  MATCH3 
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SORT2  sorts  the  output  of  MATCH,  2,  3,  and  4  using  scientific 
collating  sequence,  on  4K- NUMBER,  A/C- NUMBER,  FAIL- TIME, 
REPLACE- TIME. 

CLASS  reads  one  or  more  Calendar  Hour  Interval  Control  Cards. 
For  each  control  card  all  the  data  from  MATCH  is  read,  the  fail  and 
replace  interval  is  determined  and  an  output  record  is  generated  when¬ 
ever  a  break  occurs  on  A/ C- NUMBER,  4K- NUMBER,  FAIL- INTERVAL, 
or  REPLACE- INTERVAL  (if  no  break  occurs,  fail  and  replace  events  are 
totalled  within  the  current  interval).  A  unique  integer  is  attached  to  all 
data  associated  with  each  calendar  hour  interval  to  keep  the  data  together 
in  the  sort  following  CLASS.  In  addition,  a  listing  is  printed  (for  each 
calendar  hour  interval)  giving  the  number  of  intervals  having  data  for 
each  4K- NUMBER  with  A/C- NUMBER,  and  how  many  of  these  intervals 
had  only  one  data  event. 

CLASS  calls  a  routine  named  CONV  which  in  turn  calls  SPLIT. 
These  are  used  to  get  around  the  automatic  FORTRAN  leading  zero 
suppression  on  fields  that  are  used  in  the  following  sort. 

DESCRIPTION  OF  KEY  VARIABLES 


ISYS 

4K- NUMBER 

ISER 

A/C- NUMBER 

IX 

Calculated  Fail  Interval 

IV 

Calculated  Replace  Interval 

ITOTX 

Points  in  Fail  Interval 

ITOTY 

Points  in  Replace  Interval 

ITOTA 

Number  of  Intervals  with  data  for 
particular  A/C-4K 

ITOTB 

Number  of  above  with  only  1  data 
point 

ICT,  ICOUNT 

DATA- GROUP  identifier 

The  Flow  Chart  for  CLASS  is  given  in  Figure  4.  6. 
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Figure  4.  6:  Flow  Chart  of  CLASS 
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SORT3  sorts  the  output  of  CLASS  on  DATA- GROUP,  4K- NUMBER, 
A/C- NUMBER,  and  FAIL-INTERVAL. 

SUMRY  treats  each  data- group  separately.  For  all  records,  -within 
a  data- group,  for  a  particular  4K- NUMBER,  A/C-NUMBER,  and  FAIL- 
INTERVAL,  the  total  number  of  failure  and  replacement  events  is  calcu¬ 
lated  and  a  card  is  punched.  The  deck  of  cards  produced  by  SUMRY 
serves  as  input  for  statistical  analysis.  The  Flow  Chart  of  SUMRY  is 
given  in  Figure  4.7. 
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DATA  PROCESSING  REQUIREMENTS  FOR  THE  ESTIMATED 
REPLACEMENTS  PER  MISSION  TYPE 


0.0  SUMMARY 

In  Section  5. 4  the  expected  number  of  Critical  LRU  replacements 
per  mission  type  was  given.  Here  the  algorithm  used  to  obtain  the 
required  data  is  discussed. 

1.  0  DEVELOPMENT  OF  A  FUNCTION  MISSION 
ORIENTED  COMPONENT  LEVEL  PROB¬ 
ABILITY  OF  SUCCESS  MODEL 

It  was  pointed  out  in  Section  5.  4  that  the  mission  debriefing  data 
are  functionally  oriented.  Thus,  when  a.  functional  failure  indication  is 
observed,  it  is  no  longer  obvious  whether  a  particular  LRU  has  failed  or 
malfunctioned.  Here  the  failures  for  a  given  LRU  per  mission  are  esti¬ 
mated  by  means  of  a  probability  of  success  model.  The  model  describes 
the  relationship  between  the  failure  of  a  given  component  and  the  associ¬ 
ated  aircraft  functions.  The  functions  considered  are  given  on  the  F-lil 
Mission  Debriefing  Form  0-294  (see  Figures  2.3.3  and  2.3.4), 

In  general,  the  functions  associated  with  a  given  component  are 
those  functions  affected  by  a  failure  of  a  particular  component.  The 
definitions  of  these  functions  are  such  that  they  are  not  independent.  As 
a  result,  joint  failures  of  functions  occur.  To  describe  this  situation  in 
probability  terms,  let 

A  denote  the  component  in  question, 

S.  denote  n  independent  functional  subsets 
1  associated  with  A  and 

Pp(S^)  denote  the  probability  that  fails. 

Due  to  the  relationship  between  A  and  |S^:i  =  1,  2,  . . . ,  n}  it  follows  that 

PF(A)=f  PF(A|S.)  Pf(S.).  (i.  1) 

i=l 
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This  expression  coupled  with  (Pp(A|S^),  i  =  1,  2,  . ...  ,n}  defines  the 
model. 

The  S^'s  can  he  found  through  detailed  engineering  analysis  of  the 
components  relationship  to  the  aircraft. 

ThePF(A|S  ^)'s  are  found  by  analyzing  which  components  could 

cause  a  failure  of  a  function  contained  in  S..  Let  C(S.)  be  the  set  of 

1  1 

components  associated  in  this  manner  with  S,,.  The  C(S^)'s  may  be  found 
by  a  slight  modification  of  the  process  used  to  determine  the  functions 
associated  with  a  given  component.  3y  definition 

(1.2)  Pf(A|S.)  =  n(A)/n(C(S.)), 

where  n(A)  denotes  the  number  of  failure  indications  due  to  A  and 

n(C(S^) )  denotes  the  number  of  failure  indications  due  to  elements  of 

C(S^).  Since  A  and  G(S^)  are  defined  in  terms  of  Work  Unit  Codes  n(A) 

and;n(C(S.) )  can  be  easily  calculated  from  data  retrieved  from  the 
* 

258  data  base. 

2.  0  CALCULATION  OF  THE  DISTRIBUTION  OF  OPERATING  TIME  OR 
CYCLES  TO  FAILURE  FOR  AIRCRAFT  FUNCTIONS 

The  distribution  of  operating  time  to  failure  for  the  functions 
identified  by  the  above  method  was  calculated  using  F-lll  Mission 
Debriefing  Data.  Strictly  speaking,  four  different  types  of  failure  distri¬ 
butions  were  calculated  by  the  followinj  programs  depending  on  the 
nature  of  the  function.  The  four  types  of  distributions  calculated  are 
the  following: 

(1)  Operating  hours  to  failure, 

(2)  Landings  to  failure, 

(3)  Wing  sweeps  to  failure, 

(4)  Missions  to  failure. 

The  data  were  retrieved  from  the  F-  111  Mission  Debriefing  Data  in 
SEDS  data  base  by  FFS  and  formatted  for  processing  by  a  series  of 
FORTRAN  routines.  These  programs  were  used  to  calculate  the  distri¬ 
bution  associated  with  a  particular  function.  The  routines  which  accom¬ 
plished  these  tasks  are  described  below. 
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(1)  Select  all  records  for  a  Critical  LR.U. 

(2)  For  each  Critical  LRU  output  the  following  record. 

AIRCRAFT  NUMBER  COLS.  2-4 

FUNCTION  CODE  COLS.  5-8 

RELATED  ITEM  CODE  COL.  9 

1  -  HOURS  RELATED 

2  -  LANDINGS  RELATED 

3  -  WING  SWEEPS  RELATED 

4  -  MISSIONS  RELATED 


FLIGHT  DATE 

COLS.  10-15 

ACTUAL  LANDING  TIME 

COLS.  16-19 

NUMBER  OF  LANDINGS 

COLS.  20-21 

NUMBER  OF  WING  SWEEPS 

COLS.  22-23 

ACTUAL  TAKE-OFF  TIME 

COLS.  27-30 

PHASES  OF  FLIGHT 

COLS.  31-42 

Output  the  following  as  the  final  record: 

((( 

COLS.  2-4 

(((( 

COLS.  5-8 

3.  0  PROCESSING  THE  DATA  FROM  FFS 

The  general  processing  procedure  is  outlined  in  Figure  3. 1. 

If  files  between  steps  are  not  indicated  as  tapes,  they  are  on  inter¬ 
system  reserve  units.  The  input  to  PHASCK  (Figure  3.  2)  has  the 
following  format: 

COL.  1  Blank 

COLS.  2-4  AIRCRAFT  NUMBER  (A/C) 

COLS.  5-8  4 K- NUMBER 

COL.  9  CODE  relating  4K  to  hours, 

cycles,  or  missions 
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M. 


DEBRIEF  TAPE  FROM  FFS 


Figure  3.1:  General  Flow  Chart  of  the  Data 
Processing  Requirements 


r 


COLS.  10-15 

DATE 

COLS.  16-19 

MISSION  LENGTH 

COLS.  20-21 

NUMBER  LANDINGS 

COLS.  22-23 

NUMBER  SWEEPS 

COL. 

24 

FAIL- CODE 

COL. 

25 

MISSION- CODE 

COL. 

26 

BLANK 

COLS;  27-30 

TAKE- OFF- TIME 

COLS.  31-42 

12  1- CHARACTER  PHASES 

The  last  record  on  the  tape  is  as  follows: 

COLS.  1-4  BLANK 

COLS.  5-8  *((((* 

COLS.  9-42  BLANK 

Input  to  OTF  (Figure  3.3)  must  be  sorted  on:  4K,  A/G,  DATE- 
TAKE- OFF- TIME,  FAIL- CODE.  The  format  is  the  following: 


COL.  1 

BLANK 

COLS.  2-4 

AIRCRAFT  NUMBER  (A/C) 

COLS.  5-8 

4K- NUMBER 

COL.  9 

CODE 

COLS.  10-15 

DATE 

COLS.  16-19 

MISSION  LENGTH 

COLS.  20-21 

NUMBER  LANDINGS 

COLS.  22-23 

NUMBER  SWEEPS 

COL.  24 

FAIL- CODE 

COL.  25 

MISSION- CODE 

COL.  26 

BLANK 

COLS.  27-30 

TAKE-OFF  TIME 
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Figure  3.3:  Flow  Chart  of  OTF 


The  last  record  is  as  follows: 


COL.  1  BLANK 

COLS.  2-4  *(((' 

COLS.  5-30  BLANK 

Input  to  HSTGRM  (Figure  3.4}  is  the  following: 

COLS.  1-3  AIRCRAFT  NUMBER  (A/C) 

COLS.  4-7  4K- NUMBER 

COLS.  8-15  HOURS  TO  FAILURE 

COLS.  16-17  LANDINGS  TO  FAILURE 

COLS.  18-19  SWEEPS  TO  FAILURE 

COLS.  20-21  MISSIONS  TO  FAILURE 

COL.  22  CODE  (pointer  to  one  of  the 

above  4  fields) 

COLS.  23-24  BLANK 

The  last  record  is  as  follows: 

COLS.  1-3  BLANK 

COLS.  4-7  '((((’ 

COLS.  S-24  BLANK 

The  output  from  HSTGRM  is  sorted  on  4K-NUMBER.  Each  4K- 
NUMBER  histogram  is  spread  over  3  physical  records. 

(1)  COLS.  1-4  4K- NUMBER 

COLS.  5-94  First  10  points  (F9.7) 

COLS.  95-100  BLANKS 

(2)  COLS.  1-90  Second  10  points 

COLS.  91- 10C  BLANKS 


l 

? 

\ 
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(3)  COLS,  1-90 
COL.  91 

COLS.  92-100 


Last  1 0  points 

CODE  (hours,  cycles,  or 
missions) 

BLANK 


A  dummy  EOF  record  is  required. 

COLS.  1-4  '9999' 

COLS.  5-100  BLANKS 


PHASCK  examines  every  record  from  the  DBRIEF  input  for  failure 
or  successful  operation  during  any  phase  of  the  mission.  For  a  failure  or 
discrepancy  in  any  phase,  ah  'F'  FAIL-CODE  is  attached  to  the  record. 
For  successful  operation,  an  'A'  FAIL-CODE  is  used. 

SORT1  sorts  the  output  of  PHASCK  on  4K- NUMBER,  A/C-NUMBER, 
DATE,.  TAKE- OFF- TIME,  FAIL- CODE. 

OTF  treats  the  data  for  each  4K- NUMBER  within  A/C-NUMBER 
separately.  Each  time  to  failure  in  terms  of  operating  hours,  wing 
sweeps,  landings,  or  missions  is  calculated  by  totalling  succeeding  'A1 
records  and  the  first  'F'  record  encountered.  Upon  break  on  4K- NUMBER 
or  A/C-NUMBER,  total  fields  are  cleared  and  calculations  start  again. 


DESCRIPTION  OF  KEY  VARIABLES 


ISER 

A/C- NUMBER 

IFOURK 

4K- NUMBER 

ICODE 

Code  relating  4K- NUMBER 
to  hours,  landings,  sweeps 
or  missions 

IHRS 

IMIN 

Mission  duration 

NUMLDG 

Number  of  landings 

NUMSWP 

Number  of  Wing  Sweeps 

I  FAIL 

Success  or  Fail  (A  or  F)  Code 

lV-‘i  0 


MISCOD 

Mission  Code  (first  record  from 
BBRIEF  or  258) 

TOTHRS 

Hours  to  Failure 

ILDGS 

Landings  to  Failure 

IS  WPS 

Sweeps  to  Failure 

IMISS 

Missions  to  Failure. 

HSTGRM  reads  all  the  data  for  a  particular  4K- NUMBER  into  a 
matrix.  The  matrix  is  sorted  internally.  The  inverse  of  the  number  of 
items  in  the  matrix  (the  probability  of  each  event  occurring  is  calculated. 
A  value  of  i  times  the  probability  is  associated  with  the  first  matrix 
element,  a  value  of  2  times  the  probability  is  associated  with  the  second 
matrix  element,  etc.  For  each  of  the  30  points  on  the  histogram  (0.  5 
hours  between  points  for  hours- related  4K- NUMBERS;  integer  points  for 
landings,  sweeps,  and  mission- related  4K- NUMBERS)  either  the  2  mat¬ 
rix  elements  surrounding  the  point  desired  are  found,  or  the  matrix 
element  corresponding  exactly  to  the  point  desired  is  found.  The  desired 
probability  of  failure  is  either  interpolated  from  the  2  surrounding  proba¬ 
bilities,  or  corresponding  point  is  used.  The  actual  histogram  is  spread 
over  three  physical  records  (see  record  formats  above). 

Because  problems  were  encountered  in  determining  end  of  the  input 
file,  two  MAP  routines  are  used.  BTPIO  incorporates  various  tape 
handling  facilities.  The  file  open  (FOPEN)  routine  is  used  by  HSTGRM. 
SKIP  does  a  binary  tape  read  and  returns  a  count  of  words  read.  A  count 
of  0  indicates  EOF.  HSTGRM  calls  SKIP  and  then  if  the  count  returned 
is  non- zero,  it  backspaces  the  tape  and  does  a  FORTRAN  read. 

DESCRIPTION  OF  KEY  VARIABLES 

AMATRX  Hours  to  Failure  Matrix 

IMATRX  Cycles  to  Failure  Matrix 

BMATRX  Histogram  Matrix 
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PMATRX 


Probability  Matrix  Associated 
with  AMATRX 


PROBA  Probability  of  each  event 

(inverse  of  the  number 
of  events). 


Also  see  OTF  variables  above. 
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THE  EVALUATION  OF  CURRENT  REPLACEMENT 
REQUIREMENTS 

In  Section  5.  5  the  50,  85,  90  and  95  percentile  points  of  the  prob¬ 
ability  distribution  of  K  for  each  LRU  were  given.  Here  the  plots  and  the 
results  of  goodness  of  fit  tests  on  the  sample  distribution  of  K  are  given. 
It  is  recognized,  however,  that  K  is  approximately  normally  distributed 
by  the  Central  Limit  Theorem  from-  Probability  and  statistics  since 

10 

K  =T  p.  K. 

~  J  3 
J=1 

in  an  average.  Thus,  it  is  not  surprising  that  the  Kolmogorov-Smirnov 
test  supports  this  fact  (see  Table  i).  However,  these  results  conclude 
the  investigation. 
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Table  i:  Decision  to  reject  the  null  hypothesis  that  the  sample  distribution  of  K-value  for  a  random  mix¬ 
ture  of  missions  approximates  a  given  theoretical  distribution  function,  where  a  =  0.  05. 


>r  Normality:  K-Value  Distribution  for  Random  Mioaion  Mixture  Critical  DRU 
onizer.  Transmitter  (WUC  73DFO) 


Test  for  Normality:  K-Value  Distribution  for  Random  Mission  Mixture  Critical 
Modulator,  Receiver/ Transmitter  (WUC  73BDO) 


Test  for  Normality:  K-Value  Distribution  for  Random  Mission  Mixture  Critical  LRU 
Stabilization  Platform  Unit  (WUC  73AAO) 
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Figure  9.  Test  for  Normality:  K-Value  Distribution  for  Random  Mission  Mixture  Critical  LRU 
Navigation  Computer  CP812/AJQ-2  WUC  73 ABO 
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